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ABSTRACT 

This review of the literature related to the cloze 
procedure includes most of the studies reported from 1953 to 1971 
One hxindred ninety-eight documents are included and are divided into 
four categories, studies in which the cloze procedure has been 
applied (1) as a measure of readability, (2) as a measure of 
comprehension, (3) as a measure of language facility, and (4) as an 
instructional technique. An appendix and bibliography are included. 
(WP) 
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INTRODUCTION 

This thesis presents a review of the literature 
related to the cloze procedure f and includes all the studies 
reported ■Trom 1953 to 1971f the exceptions being those docu- 
ments unavailable at the time of this ^vriting. 

A total of two hundred twenty-two documents were 
examined* Of these t one hundred ninety-eight were selected 
as being related in some respect to the cloze procedure. 
One hundred twenty-six abstracts have been included in the 
body of the thesis and the remaining seventy-two references 
have been included in the Appendix. 

References in Section I of the Appendix are classi- 
fied to correspond with the five chapters of the thesis. 
Section II contains twelve additional references assumed 
to be of significance but which were unavailable at the 
time this thesis was prepared. 

The Bibliographyt a composite of all one hundred 
twenty-six abstracts t is also classified to correspond with 
the five chapters* 



CHAPTER I 



THE CLOZE PROCEDURE: AN OVERVIEW 



In 1953 Taylor-'- introduced a technique for measur- 
ing readability which he named "the cloze procedure," The 
name of this new technique was derived from the Gestalt 
concept of "closure" which hypothesizes that the reader 
completes a structural whole by filling in a missing gap. 

Taylor defines cloze ast 

A method of intercepting a message from a 'trans- 
mitter* . . . mutilating its language patterns by 
deleting parts, and so administering it to 're- 
ceivers* . . . that their attempts to make the pat- 
terns whole again potentially yield a considerable 
number of cloze units. 2 

A cloze unit is 

. . • any single occurrence of a successful attempt 
to reproduce accurately a part deleted from *a mes- 
sage* ... by deciding from the context that re- 
mains, what the missing part should be, 3 

Althoulpif the cloze procedure per se is a relatively 

new concept, word deletion techniques were used by 



Wilson L. Taylor, •'*Cloze Procedure*! A New Tool 
Jor Measuring Readability," Journalism Quarterly . 30 (1953), 

^Ibid., t^l6, 
^Jbid. 
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Ebbinghaus, as reported by Rankin,^ in 189? in the con- 
struction of an intelligence test. Applications of the word 
deletion technique may be observed in several current psy- 
chological instruments and in the use of incomplete sen- 
tences in measures of scholastic achievement. Vocabulary 
tests utilize, the word deletion technique to determine the 
reader's sensitivity to context clues. The cloze proce- 
dure, however, should not be confused with the latter word 
deletion techniques. 

Omitted words in sentence completion tests and 
vocabulary tests requiring the use of context clues are de- 
termined by the test constructor in terms of specific mean- 
ing, context, and the purpose of the test. In contrast, 
cloze deletions may occur at an^ point in a continuous 
passage by means of a specific, objective criterion. Suc- 
cess or failure in predicting omitted words may or may not 
influence subsequent success or failure. Contextual clues 
in a cloze test may be far removed from a cloze deletion 
and not immediately surround it, as they would in a vocabu- 
lary test of sensitivity to context clues. 

Cloze deletions are made oy means of a specific, 

,r st^ij. ?ankin, Jr., "The Cloze Procedure - Its 

Validity and Utility," Starting and Improving Collp gr Read- 

ff'off^ams, ed. by Oscar S. Causey and William Elli?; 

Eighth Yearbook of the National Reading Conference (Milwau- 
£®6» Jisconsint National Reading Conference, 1959), pp. 
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objective criterion which takes one of two forms : an every 
"nth" word deletion or the deletion of every word of a par- 
ticular syntactic type. The former is sometimes referred 
to as a structural deletion and the latter as a lexical 
deletion. Structural deletions may be made on the basis 
of every second, or fifth, or tenth word, for example, or 
by a more sophisticated randomizing procedure of the re- 
searcher's choice. Lexical deletions are usually limited 
to nouns or verbs, although any syntactic element may be 
chosen as the deletion criterion. The first and last sen- 
tences of the passage are not generally included in the 
procedure in order to permit the reader to become familiar, 
to some degree, with the topic of the passage. 

Deleted words are replaced by a blank line of 
standard length. Scoring is computed on the basis of either 
the number of correct exact replacements, the number of 
acceptable synonym replacements, or the number of correct 
form class replacements. 

Studies investigating the effects of different 

cloze test forms and different scoring systems have been 

1 

conducted by Bormuth. The use of exact-length blanks in 

^John R. Bormuih, "Experimental Applications of 
Cloze Tests," Improvement of Reading Through Classroom 
Practice, ed. by J. Allen Pigurel, Proceedings of the Inter- 
national Reading Association (Newark, Delaware t Interna- 
tional Reading Association, 1964), pp. 303-306» John R. 
Bormuth, "Validities of Gramraaticax and Semantic Classifi- 



cloze tests of reading comprehension have been investi- 
gated by Anderson. Various theoretical and practical as- 
pects of the cloze procedure have been discussed by Culhanei 

Hafneri Ohnmacht, Weaver, and Kohlerj Rankin j Taylor t 

2 

Tuinman and Blantonj and Weaver. 



cations by Cloze Test Scores," Reading and Inouirv . ed. by 
J. Allen Figurel, Proceedings of the International Reading 
Association (Newark, Delaware: International Reading Asso- 
ciation, 1965 )t pp. 283-286. 



Jonathan Anderson, "A Report of Research on Compre- 
hension in Reading" (paper presented at the Third Interna- 
tional Reading Association World Congress on Reading, Syd- 
ney, Australia, August 7-9, 1970). 

2 

Joseph W, Culhane, "Cloze Procedures and. Comprehen- 
sion," The Reading Teacher . 23 (1970), 410-^13, ^64 j Law- 
rence E. Hafner, "Relationships of Various Measures to the 
•Cloze*," New Concepts in College-Adult Readin p ^ . ed. by Eric 
L. Thurston and Lawrence E. Hafner, Thirteenth Yearbook of 
the National Reading Conference (Milwaukee, Wisconsin: Na- 
tional Reading Conference, 1963)f pp. 135-1^5: Lawrence E. 
Hafner, "Implications of Cloze," The Philosophical and 
Sociologi cal Bases of Reading , ed. by Eric L. Thurston and 
Lawrence E. Hafner, Fourteenth Yearbook of the National 
Reading Conference (Milwaukee, Wisconsin: National Reading 
Conference, 1965)f pp. 151-158» Fred Ohnmacht, Wendell W. 
Weaver, and Emmett T. Kohler, "Cloze and Closure: A Fac- 
torial Study," The Journal of Psychology . 74 (1970), 205- 
217 » Earl F. Rankin, Jr., "The Clone Procedure - Its Valid- 
ity and Utility," Starting and Improving College Reading 
Programs, ed. by Oscar S. Causey and William Eller, Eighth 
Yearbook of the National Reading Conference (Milwaukee, 
Wisconsin: National Reading Conference, 1959), pp. I3I- 
Mt Earl F. Rankin, Jr., "Closure and the Cloze Procedure," 
College and Adult Reading , ed. by David M. Wark, Confer- 
ence Proceedings of the North Central Reading Association 
(Minnepolis, Minnesota: University of Minnesota, 1964), 
pp. 54-84j Earl F. Rankin, Jr., "Research Design and the 
Cloze Procedure," Vistas in Reading , ed. by J. Allen 
Pigurel, Proceedings of the International Reading Associa- 
tion (Newark, Delaware* International Reading Association, 
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Since its introduction by Taylor in 1953 the cloze 
procedure has been applied with increasing frequency to 
studies concerned with readability, comprehension, language 
facility, and educational methodology. Subsequent chapters 
of this thesis present the literature pertinent to these 
four categories. 



1966)1 Wilson L. Taylor, "Recent Developments in the Use of 
Cloze Procedure,*" Journalisin Quarterly . 33 (I956). 42-48: 

Preceding, Follow- 
ing, and Surrounding Contexts on Cloze Performance" (paper 
presented at the Annual Meeting of the National Reading Con- 
fnrS°^|.i!TI.' December 3. 1971); J. Jaap Tuinman 

™ ®* Blanton, The Cloze P rocedure « Cnrnn ar.^PB of 

^Hor^'n^ (Bloomington, Indiana . Schoor3f"Ed5^a- 

li?"* University of Indiana, 1971) » Wendell W. Weaver, 

Theoretical Aspects of the Cloze Procedure," The Philosophi - 
cal, and Sociological Bases of Reariin f r ^ ed. by Eric L. 

Thurston and Lawrence E. Hafner, Fourteenth Yearbook of the 
Rf:J?!J^ r ^l^*"^ Conference (Milw{.ukee, Wisconsin. National 
Reading Conference, I965), pp. II5-I32. 



ANDERSON, JONATHAN. A REPORT OF RESEARCH ON Cora>REHENSION IN 
READING. PAPER PRESENTED AT THE THIRD INTERNATIONAL 
READING ASSOCIATION WORLD CONGRESS ON READING, SYDNEY, 
AUSTRALIA, AUGUST 7-9. 1970. 



Purpose : The use of exact-length blanks in cloze tests of 
reading comprehension was investigated. 



Princi ples. ConceptSt or Procedures ? Subjects were indigenous 
primary-school pupils in New Guinea for whom English was a 
foreign language. 



Conclusions ; No significant difference was found between the 
mean scores of subjects on cloze tests using blanks of a uni- 
form length and the mean scores of subjects on cloze tests us- 
ing blanks of the same length as the deleted words. Both ver- 
sions of cloze tests were equally valid as measures of general 
reading comprehension. The question of length of blank to use 
in clnze tests has practical as well as theoretical signifi- 
cance for teachers ix^ constructing cloze tests when they wish 
to use photocopying facilities. The implication of these find- 
ings is that by the use of a photocopy procedure, such factors 
as size of print, illustrative material, and page layout may 
be included in the estimate of the ease or difficulty of 
printed material as measured by cloze tests. Tables and refer- 
ences are included. l 



Research in Education (Washington, D.C.t United States 
Governiaent Printing Olfice, 1971). Vol. 6, No. ^f, p. 111. 
(2D 0^5 323. 13 pages;. 
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BORMUTH, JOHN R, "EXPERIMENTAL APPLICATIONS OF CLOZE TESTS." 
IMPROVEMENT OF READING THROUGH CLASSROOM PRACTI CE. 
EDITED BY J. ALLEN FIGUREL. PROCEEDINGS OF THE~ INTERNA- 
TIONAL READING ASSOCIATION. NEWARK, DELAWARE: INTERNA- 
TIONAL READING ASSOCIATION, 1964, 303-306„ 



Purpose ; The author states three purposes for the study. 

1. to discover if the five forms of a cloze test made 
from the same passage differ in difficulty. 

2. if they do, by how much. 

3« to determine if these differences were influenced by 
the number of items inc'.uded in the forms. 



Principles. Concepts, or Procedures : Five cloze tests of 50 
items each were made over each of 20 passages. Deletions were 
made so that every word in a 250 word section of every passage 
became a deletion item in one of the five forms. The passages 
ranged in Dale-Chall readability from approximately 4.0 to 8.0 
and were chosen from textbooks and literary works. The 695 
subjects were organized into five groups on the basis of 
Stanford Reading Achievement Test scores. A different form 
of the cloze test was assigned to each group. Only exact-word 
replacements were accepted. 



Conclusions : The following conclusions were reached. 

1. The means on different cloze test forms that are 
made from the same passage differ significantly 
for tests of 50 items or less. . . . 

2. The differences in difficulty among test forms 
made from the same passage tend to diminish as 
more items are included in the test forms. 

3. The practice of using only a single cloze test 
form over each of the passages that a researcher 
is studying should probably be avoided where pre- 
cise determinations of passage difficulties are 
needed and especially when the passages are short. 
In such experiment J all five forms should be used. 



When single forms are used in experiments it is 
necessary to show that the observed differences 
are sufficiently large to assure that they did 
not arise solely because of the test forms. . . 
(306) 



BORMUTH, JOHN R. "VALIDITIES OF GRMATICAL AND SEMANTIC 

CLASSIFICATIONS OF CLOZE TEST SCORES." READING AND IN - 
QUIRY . EDITED BY J. ALLEN FIGUREL. PROCEEDINGS OF THE 
INTERNATIONAL READING ASSOCIATION. NEWARK, DELAWARE: 
INTERNATIONAL READING ASSOCIATION, I965, 283-286. 



Purpose.: 

* . . cloze test responses are classified accord- 
ing to their semantic and grammatical relationships 
tc the deleted word and scores based on each of 
these categories are studied to find out which are 
the most valid when the tests are used to measure 
reading ability and passage difficulty. (283) 



Principles, Concepts, or Procedures : A 52-item cloze test was 
constructed over each of 20 passages. These were administered 
to 50 fifth and sixth grade subjects. Two tests per test 
period were given during a ten day period. There were no time 
limits. The Stanford Achievement Test: Reading was given 
prior to the cloze testing. 



Conclusions : 

1. When cloze tests are used as measures of individ- 
ual differences in reading ability, scores obtained 
by counting responses exactly matching the deleted 
words seem to yield the most valid scores. 

2. When cloze tests are used in readability studies 
as measures of the comprehension difficulties of 
passages, scores obtained by counting responses ex- 
actly matching the deleted words seem to yield the 
greatest amount of discrimination among passage dif- 
ficulties. (285) 
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CULHANE, JOSEPH W. "CLOZE PROCEDURES AND COMPREHENSION." THE 
READING TEACHER . 23 (1970), 410-413, 464. 



Purpose t The author discusses the history of the cloze proce- 
dure, as well as the construction, scoring, and uses of cloze 
materials. 



Principles. Conce-pts. or Procedures t The studies made of the 
cloze procedure since 1953 have demonstrated its usefulness to 
the reading field particularly in the area of teaching and 
testing comprehension. 

Once the deletion pattern has been decided, a researcher 
deletes words in every sentence of a passage, except the first 
and last sentence, and replaces each deleted word with a 
blank space. The blanks should be of uniform length in test- 
ing situations. However, in teaching situations, they may be 
as long as the deleted. word and may even begin with the first 
letter of the deleted word. Exact word replacements should 
be required when the exercises are used as a test device. 
Sjrnonyms should be accepted in teaching situations and discus- 
sion of answers should take place. 

Cloze is a useful technique for use with word callers, 
for it forces attention to context as the passage is read and 
not afterwards. Cloze is also useful in promoting better 
language patterns. 



Conclusions t The cloze technique is easily learned and put to 
use by both teachers and pupils. To complete deletions cor- 
rectly, careful reading and the use of context are required. 
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HAPNER, LAWRENCE E. -RELATIONSHIPS OP VARIOUS MEASURES TO THE 

•CLOZE»." NEW CONCEPTS IN COLLEGE-ADULT READING . EDITED ' 
BY ERIC L. THURSTON AND LAWRENCE E. HAPNER. THIRTEENTH 
YEARBOOK OP THE NATIONAL READING CONFERENCE. ' MILWAUKEE, 
WISCONSIN! NATIONAL READING CONPERENCE, I963, 135-145. 



Purpose t This researcher investigated the relationships of 
various measures (vocabulary, intelligence, information, achieve 
ment, personality, and reasoning) to pre-reading cloze. 



Principles* Concepts» or Procedures t Subjects were thirty-two 
male and female senior college students enrolled in a reading 
methods course. 

A 50-item cloze test using every-fifth-word deletions was 
developed from an article on educational television. Among 
other instruments used weret M ichigan Vocabulary Profile Test t 
Otis Quick-Scoring Mental Ability" Test. Gamma : Cat tell 16 Per - 
sonality-Factor Questionnaire : and Wechsler-Bellevue Intelli - 
gence Scale . Information sub-test. 



Conclusions : 

1. Cloze scores correlated positively and significantly 
with vocabulary, intelligence, information, achievement, and 
reasoning. They were not related to introversion. 

2. Cloze scores compared favorably with standard predic- 
tors as a predictor of course grades. 
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HAPNER, LAWRENCE E. "IMPLICATIONS OP CLOZE." THE PHILOSOPHICAL 

AND SOCIOLOGICAL BASES OF READING . EDITED BY ERIC L. 

THURSTON AND LAWRENCE E. HAFNER. FOURTEENTH YEARBOOK OF 
THE NATIONAL READING CONFERENCE. MILWAUKEE, WISCONSIN r 
NATIONAL READING CONFERENCE, I965, I5I-I58. 



Purpose t The author discusses the implications of the cloze 
procedure. 



Principles. Concep ts, or Procedures : The author indicates 
that cloze tests are valid measures of comprehension but should 
not be used as replacements of informal inventories. Each can 
complement the other. 

Cloze is useful for improving the writing of materials. 
To be intelligible, materials require an amount of redundancy 
as opposed to the terseness so often found in concept-laden 
material . 

The author suggests that cloze can be modified to show 
the role of reasoning in reading and to discover the dynamics 
of the thinking process in individual students. 

In addition to studies of readability, cloze has applica- 
tion to language creativity. 

Cloze tests utilizing letter deletions as opposed to word 
deletions yielded high correlations with elementary reading 

XGS vS • 



Cpnclusions « A center for the collection and dissemination of 
cloze knowledge would be useful to education. 
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OHNMACHT, PRED» WEAVER, WENDELL W.j AND KOHLER, EMMETT T. 

"CLOZE Ar,'D CLOSURE I A FACTORIAL STUDY." THE JOURNAL OF 
PSYCHOLOGY . 74 (197 0^ , 205-21?. 



Purpose I The authors explored 

. . . the relationship of flexibility of closure 
and speed of closure to a number of cloze tasks 
representing structural, lexical, concrete, and 
abstract deletions. (206) 



Principles. Concepts, or Procedures i The Hidden Patterns Test 
and the Hidden Figures Test , and the Gestalt Completion Test 
and the Concealed V/ords Test were administered to determine 
flexibility and speed of closure respectively. Measures of 
associational fluency and verbal comprehension were deter- 
mined from the Controlled Associations Test and the Association 
IV, and the Wide Range Vocabulary Test and the Advanced Vocabu - 
lary Test respectively. 

The cloze tests were developed from materials previously 
graded for difficulty.! The structural cloze tests deleted 
every fifth word regardless of function. Lexical cloze tests 
were made by deleting every fifth noun, verb, or adjective. 
Abstract noun and concrete noun forms were developed from the 
rationale that abstract nouns describe "objects" not perceiv- 
able by the senses while concrete nouns describe words which 
are perceivable. Every-fifth-word deletions were also used in 
these two forms. 

Subjects were 115 high school students who were adminis- 
tered the test battery over a two week period. The cloze test 
ecoring required exact replacements. 



Conclusions t 

1. Structural and concrete cloze tasks yielded higher means 
than did lexical and abstract ones. 

2. Some relationship exists between flexibility and speed 
of closure and cloze tasks. Flexibility, however, is more 
closely related to cloze tasks. 



^Sea G. R, Miller and E. B. Coleman, "A Set of Thirty-Six 
Proso Passages Calibrated for Complexity," p. 61 of this thesis. 
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RANKIN, EARL P., JR. "THE CLOZE PROCEDURE - ITS VALIDITY AND 
UTILITY." STARTING AND IMPROVING COLLEGE READING PRO - 
GRAMS . EDITED BY OSCAR S. CAUSEY AND WILLIAM ELLER'. 
EIGHTH YEARBOOK OP THE NATIONAL READING CONFERENCE. MIL- 
WAUKEE, WISCONSIN! NATIONAL READING CONFERENCE, 1959, 



Purpose I The author 

1. considers the validity of the cloze procedure as a 
measure of readability, intelligence, pre-reading knowledge, 
and aspects of reading comprehension. 

2. offers suggestions concerning the use of the procedure. 



Principles. Concepts, or Procedures » An explanation of the 
cloze procedure and a comparison with other techniques such as 
sentence completion tests are given initially. 

As measures of readability, the traditional formulae are 
insensitive to short, abstract words and sentences, and to 
irregular grammatical characteristics of some sentences. 
Cloze is a more reliable measure of readability, for it de- 
letes systematically words from sentence patterns so that the 
reader can replace them because of his ability to predict from 
the surrounding redundancy. 

Cloze appears to be a measure of intelligence only when 
all word classes have an equal chance of being deleted. Dele- 
tions of nouns, verbs, and adjectives yield very low correla- 
tions because of the difficulty in replacing them when all 
words of those classes are missing from context. 

As a measure of knowledge before reading, cloze is a valid 
predictor when a second test is used as a criterion measure. 
Deletions of nouns, verbs, and adjectives are most highly dis- 
criminating here. 

Recent research indicates high correlations between cloze 
scores and general reading comprehension. Lexical comprehen- 
sion car, also be measured by cloze when high meaning units such 
as nouns and verbs are deleted. High correlations have been 
reported between clo^e scores and immediate recall. Cloze is 
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presumably a valid measure of post-reading comprehension# 

The usefulness of cloze tests can readily be seen when the 
time required for writing objective questions is considered. 
Equivalent forms can be made from the same materials. However 
there is some evidence that subjects with above average anxiety 
perform poorly on cloze tests. 

The classroom teacher will find cloze useful in determining 
the readability of textbook material, as a measure of general 
comprehensiont and as a diagnostic tool where discussion of re- 
placed words occurs. 



Conclusions X Many aspects of the cloze procedure require in- 
vestigation ro fully realize its potentialities. 
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RANKIN, EARL P. "CLOSURE AND THE CLOZE PROCEDURE." COLLEGE 
AND ADULT READING . EDITED BY DAVID M, WARK. CONFERENCE 
PROCEEDINGS OF THE NORTH CENTRAL READING ASSOCIATION. 
MINNEAPOLIS, MINNESOTAt UNIVERSITY OF MINNESOTA, 1964. 
5^-84, 



Purpose t The author reviews selected studies on closure rele- 
vant to the cloze procedure. 

Principles. Concepts, or Pr ocedures ! Rankin begins by defining 
the cloze procedure and tracing its rationale from Gestalt 
psychology. 

The nature of closure is next considered. The role of pre- 
vious experience and the implications of neurological theory 
are discussed. The research studies of Street, Thurstone, 
Rimaldi, Bechtoldt, Pemberton, and Mooney are discussed rela- 
tive to speed and flexibility of closure. The relationship of 
closure to cognition, personality, reading, and age and sex 
differences are considered with reference made to research. 

Rankin believes "... the cloze procedure probably in- 
volves cognitive more than visual closure." {71^) Auditory- 
motor closure may, in some instances, be involved. These three 
behavioral levels are not necessarily related. 

Personality factors such as rigidity and impulsivity, 
social context, particularly anxiety, and age differences are 
cited as important considerations relative to closure, cloze, 
and the total reading process. 

Conplusions t Rankin hopes a degree of closure will result 
Within individuals rv,?ading this paper. 

A bibliography of sixty-seven references is included. 
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RANKIN, EARL P., JR. -RESEARCH DESIGN AND THE CLOZE PROCEDURE." 
VISTAS IN READINS. EDITED BY J. ALLEN FIGUREL. PROCEED- 
INGS OF THE INTERNATIONAL READING ASSOCIATION. NEWARK. 
DELAWARE! INTERNATIONAL READING ASSC'OIATION. 1966. 489-491. 



Purpose i The author discusses two approaches to improving re- 
search design in studies utilizing the cloze procedure. 

Principles, Concepts, or Procedureg i Rankin contends that com- 
prehension IS usually measured as an -after reading" product. 
Since individuals approach reading tasks with some previous 
knowledge it is desirable to know what information ivas gained 
from the passage alone. The cloze procedure is an effective 
device for measuring residual gain. 

Because the skills required for success in the cloze pro- 
iSfSlvi^l.^^ • ^""^ ""^y possibilities as a ?eacS. 

Si?rSf^*oe?J!-i?i?^^ procedure is a powerful research tool 
With many possibilities yet to be realized. 



TAYLOR, WILSON L. "RECENT DEVELOPMENTS IN THE USE OF ' CLOZE 
PROCEDURE.*" JOURNALISM QUARTERLY t 33 (1956), 42-48 • 



Purpose t The author reports results from recent studies he 
conducted to investigate the appropriateness of. cloze as a 
measure of comprehension in both English and Korean, of lis- 
tenability news broadcasts, and of intelligence, existing 
knowledge, and learning* 



Principles » Concepts t or Procedures : Subjects in the Sampson 
Air Base study were administered two comprehension tests, two 
cloze tests, and an intelligence test to determine "before" 
and "after" learning as well as intelligence • 

Easy, medium, and hard passages in the Korean language 
were adapted to cloze and administered to Korean college stu- 
dents* 

A "good" and a "bad" script both utilizing cloze, were 
prepared for two stories which were read by an experienced 
announcer to determine listenability. 



Conclusions ! 

1. Cloze is a reliable measure of comprehension, and, 
hence, readability. 

2# Learning and intelligence also seem to be measured. 
3. Cloze is a discriminator between the listenabili- 
ties of two oral presentations. 

Among other conclusions weret 

1. "There seems to be little advantage in preclassify- 
ing words and limiting deletions to them. ..." (48) 

2. There was no advantage to scoring synonyms. 

3. Every fifth -word deletion located blanks as far 
apart as they needed to be. 

4. A series of about 50 deletions was sufficient to 
yield a stable score of the difficulty of a given 
passage . 
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TAYLOR, WILSON L. "RELATIVE INFLUENCE OF PRECEDING, FOLLOWING, 
AND SURROUNDING CONTEXTS ON CLOZE PERFORT/IANCE.*' PAPER 
PRESENTED AT THE ANNUAL MEETING OF THE NATIONAL READING 
CONFERENCE, TAMPA, FLORIDA, DECEMBER 3, IQ?!. 



Purpose t The influences of "preceding," "following," and 
"surrounding" contexts on cloze responses were investigated. 



Principles. Concepts, or Procedures t Forty-five prose frag- 
ments were drawn from a short story, "The Egg," by Sherwood 
Anderson. Each fragment consisted of eleven words. The 
middle word in each fragment — the sixth— was deleted. Three 
forms for each fragment were prepared; one presented both the 
five "preceding" and "following" contexts while the remaining 
two presented either the "preceding" or "following" contexts. 

The resulting 135 fragments were organized into three 
assemblies of forty-five fragments each so that fifteen of 
each of the three versions of context appeared. 

Subjects were nineteen college students. Each response 
was scored as like or unlike the original word and the re- 
sponses of other subjects. 



Conclusions t 

1. "Preceding" and "following" contexts were found to be 
about equal in their influences on cloze responses. 

2. Taylor notes the limitations of the study and suggests 
replication incorporating other subjects and materials. 
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TUINMAN, J« JAAPt AND BLANTON, B. ELGIT. THE CLOZE PROCEDURE 8 
COROILARIES OF A SEARCH HYPOTHESIS > BLOOMINGTON, INDIANA t 
SCHOOL OF EDUCATION, UNIVERSITY OF INDIANA, 1971. 



PurPi^se t In order to determine whether the kind of process un- 
derlying cloze responses is indeed a systematic and exhaustive 
searchf a study was conducted exploring some corollaries to 
such a search hypothesis. 



Principles. Concepts, or Procedures > It was assumed that sub- 
jects would generate responses representing a number of word 
typeSf that some of these word types would be sensible and some 
nonsensical t and that responses would be representative of the 
entire body of possible response words. Five versions of a 
300-word cloze passage t every fifth word deleted, were admin- 
istered to 390 junior-high-school students who were randomly 
assigned to cue of the versions. Protocols were hand scored 
and success probabilities were calculated. A correlation 
matrix among seven variables was calculated and analyzed using 
a stepwise regression program. 



Conclusions : Significant correlations were noted among the 
seven variables, with the highest correlation appearing between 
size of response body related to success probability. It w^« 
concluded that the general search hypothesis appeared to be 
sustained since distribution of responses was related to suc- 
cess probability and since the ratio of nonsense to sensible 
responses was relevant to that distribution. It was implied 
that a search process could be characterized as systematic in 
part. Tables and references are included.^ 



'' "Research in Education (Washington, D.C.« United States 
Government Printing Office, 1971 )# Vol. 6, No. 6, pp. 104-105. 
(ED 047 913f 13 pages). 
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WEAVER, WENDELL W. "THEORETICAL ASPECTS OP THE CLOZE PROCEDURE." 
THE PHILOSOPHICAL AND SOCIOLOGICAL BASES OF RRADTNn. 
EDITED BY ERIC L. THURSTON AND LAWRENCE E. HAFNER. FOUR- 
TEENTH YEARBOOK OP THE NATIONAL READING CONFERENCE. MIL- 
WAUKEE, WISCONSIN! NATIONAL READING CONFERENCE, I965, 115- 



Puypose t The author discusses various theoretical aspects of 
the cloze procedure, particularly that of language and thought. 



Principles. Conce pts, or Procedures t Weaver questions whether 
the rationale for the cloze procedure is, in fact, Gestaltist 
in nature. Since there is no evidence that cloze units are- 
completed in a perceptual fashion, he prefers to view the pro- 
cedure as a coding operation. 

Language and thought are complexly bound together and 
form an important attribute of the cloze procedure. One means 
of studying cloze in this situation is by making structural 
and lexical deletions. To these deletions, syntactic and se- 
mantic constraints are closely related. 

Structural cloze scores are better predictors of reada- 
bility probably because they are dealing with the absence 
rather than the presence of redundancy. The cloze procedure 
is essentially a searching procedure which again emphasizes 
the importance of language and thought. 



Conclusions I Diverse areas of education and the social sciences 
nave made use of -the cloze procedure. An area requiring study 
is that of syntactic and semantic effects of context on particu- 
lar language units. 



CHAPTER II 



THE CLOZE PROCEDURE AS A MEASURE 
OF READABILITY 

The initial research related to the cloze procedure 

as a measure of readability was undertaken by Taylor^ who 

found that prose passages written by Stein, Caldwell, and 

Joyce were assessed more accurately by the cloze procedure 

than by the Dale-Chall and Plesch formulae. Moreover, 

Taylor found that selected passages were ranked in exactly 

the same order of difficulty by these three methods. 
2 

Bormuth also investigated the validity of assess- 
ing readability by means of cloze tests. The influences 
of sample size and number of items on the precision of 

cloze tests used for readability purposes were also inves- 

3 4- 
tigated by Bormuth. Later, Bormuth isolated factors of 

* ^^ilson L. Taylor, "'Cloze Procedure • i A New Tool 
for Measuring Readability, - Journalism Quarterly . 30 
(1953) t 414-438. ^ 

John Robert Bormuth, "Cloze Tests as Measures of 
Readability and Comprehension Ability" (unpublished Ed.D. 
dieeertation, Indiana University, 1962). 

bormuth, "Optimum Sample Size and Cloze Test 
Length in Readability Measurement," Journal of Educat ional 
Measurement . 2 (I965), 111-116. 

Bormuth, "Readability! A New Approach," Reading 
Research Qp^rterl^, 1 (1966), 79-131 J John R. BormmJth; 
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importance in the development of readability formulae. 

1 

Bormuth and MacDonald tested the hypothesis that 
cloze test scores are positively correlated with the ability 
to detect an author's style. 

Specific instructional materials designed for use 

by students have been assessed for readability by means of 

2 

the cloze procedure. Gallant estimated the readability of 
primary grade reading materials. Covington assessed the 
readability of third, and fourth grade modern mathematics 
textbooks, while Kulm estimated the readability of elemen- 
tary algebra textbooks. 



New Data on Readability,- Forging Ahead in Reading , ed. by 
J. Allen Figurel, Proceedings of the International Reading 
Association (Newark, Delaware: International Reading Asso- 
ciation, 1967), pp. 488-492 » Cloze Readability Procedure . 
(Los Angeles I Center for the Study of Evaluation of In- 
structional Programs, University of California, 196?). 

^John R. Bormuth and 0. L. MacDonald, "Cloze Tests 
as a Measure of Ability to Detect Literary Style," Reading 
and Inquiry, ed. by J. Allen Figurel, Proceedings of the 
International Reading Association (Newark, Delaware: Inter- 
national Reading Association, I965), pp. 287-290. 

2 

Ruth Margaret Frances Gallant, "An Investigation 
of the Use of Cloze Tests as a Measure of Readability of 
Materials for the Primary Grades" (unpublished Ed.D. dis- 
sertation, Indiana University, 1964). 

^Richard John Lee Covington, "An Analysis of Reada- 
bility of Third and Fourth Grade Modern Mathematics Text- 
books Using the Cloze Procedure" (unpublished Ed.D. disser- 
tation, University of California, Los Angeles, 1966). 

Gerald Kulm, "Measuring the Readability of Elemen- 
tary Algebra Using the Cloze Technique" (paper presented 
at the Annual Meeting of the American Educational Research 
Association, New Yoi N. Y., February 4-7, 1971). 
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The readability of encyclopedia content designed 
for elementary school pupils has been assessed by Liske.^ 
Proese compared Dale-Chall readability ratings of sixth 
grade science textbooks with cloze results. The readabil- 
ity of certain high school textbooks was determined by 
Beard. The cloze procedure was utilized by Froelich^ in 
measuring the readability of selected college level elec- 
tronics textbooks, and by Houska in estimating the reada- 
bility of industrial education content material at the high 
school level. 

The development of other readability scales has 

^ilfred Wallace Liske, "The Cloze Procedure for 
Determining Readability of Encyclopedia Material for Ele- 
mentary School Pupils" (unpublished Ed.D. dissertation. 
University of Maryland, 1968). ^ai,ion, 

2 

11 B Victor Proese, "Cloze Readability Versus the Dale- 
Ohall Formula" (paper presented at the Annual Meeting of 
the International Reading Association, Atlantic City? New 
Jersey, April 19-23, 1971). 

3 

Jacob G. Beard, "Comprehensibility of High School 
Textbooks: Association With Content Area," Journal of 
Reading . 11 (I967), 229-23^. ^ 

4 

A Donald Max Proelich, "A Comparison of Two Methods 
of Assessing Textbook Readability of Selected College 

Electronics Textbooks" (unpublished Bd.D. disierta- 
tion. University of Missouri - Columbia, I97O). 

^Jocsph Thomas Houska, "The Efficacy of the Cloze 
Procedure as a Readability Tool on Technical Content Ma- 
terial as Used in Industrial Education at the High School 
Leycl^ (unpublished Ed.D. dissertation. University of 
Illinois at Urbana-Champaign, 1971). 
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been facilitated by the cloze procedure. Miller and Cole- 
1 

man »atilized three different cloze techniques to develop 
a set of prose passages ranging in difficulty from first 
grade reading material to technical material. The result- 
ing Miller-Co leman Readability Scale has been validated by 
2 

Aquino. 

Fry utilized the cloze procedure as one of three 
criterion measures in assessing the validity of the Fry 
Readability Graphs Noun frequency counts in combination 
with the cloze procedure have been used by Elley^ to mea- 
sure readability. 

With respect to readability, studies have focused 
on the difficulties within prose selections. Taylor^ 

^G. R. Miller and E. B. Coleman, "A Set of Thirty- 
six Prose Passages Calibrated for Complexity," Journal of 
verbal Le arning and Verbal Behavior . 6 (1967), 851-854. 

^ilagros Aquino, "The Validity of the Miller- 
Coleman Readability Scale," Reading Research Q uarterly, 
(1969), 3^2-357. 

3 

Edward B. Pry, The Readability Graph Validated 
at Primary Levels (Cambridge, Massachusetts t Computer 
Assisted Instruction Laboratory, Graduate School of Educa- 
tion, Harvard University, I969). 

^ «f Jfarwick B. Elley, "The Assessment of Readability 

Frequency Counts," Reading Research Quarterly . 4 
(1969)* 411-427. 

^ilson L. Taylor, "Application of 'Cloze' and 
Bitropy Measures to the Study of Contextual Constraint in 
Samples of Continuous Prose," (unpublished Ph.D. disser- 
tation. University of Illinois, 1954). 
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and MacGinitie investigated the effects of contextual con- 
straint in English prose paragraphs on readability and 

2 

comprehension, while Aborn, Rubenstein, and Sterling and 
3 

Blake investigated contextual constraint upcn words within 
sentences. 

Jefferson analyzed lexical and structural cloze 
deletions as measures of readability. Rentel^ assessed the 
effects of combining a word classification system with word 
length to measure the difficulty of certain word categories. 



Walter Harold MacGinitie, "Contextual Constraint 
in English Prose" (unpublished Ph.D. dissertation, Columbia 
University, I960). 

c.^ Murray Aborn, Herbert Rubenstein, and Theodor D. 

Sterling, "Sources of Contextual Constraint Upon Words in 
Sentences," Journal of Experimental Pgychologv . 57 (1959), 
171~180 . 

3 

James Herbert Blake, "Cloze Scores, Agreement 
Scores, and Approximated Equivalence Scores as Indices of 
Contextual Constraint" (unpublished Ph.D. dissertation. 
Syracuse University, 1970). 

George Lee Jefferson, Jr., "Lexical and Structural 
Items as Predictors of Readability for High and Low Ability 
Readers" (unpublished Ph.D. dissertation. University of 
Georgia, I969). 

^Victor Michael Rentel, "Form Class and Word Length 
as Indices of the Difficulty of Predicting Cloze Entries in 
a Sample of Continuous Prose" (unpublished Ph.D. disserta- 
tion. University of South Carolina, 1969). 
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ABORN, MURRAY; RUBENSTEIN, HERBERT; AND STERLING, THEODOR D. 
"SOURCES OF CONTEXTUAL CONSTRAINT UPON V/ORDS IN SEN- 
TENCES." JOURNAL OF EXPERIMENTAL PSYCHOLOG Y. 5? (19^9). 
171-180. • ^ ' 



Purpose ; "This study investigated the constraint upon words 
attributable to the length, distribution, and structure of 
context consisting of incomplete sentences." (171) 



Principles. Conce pts, or Procedures > From about 3000 sen- 
tences drawn at random from a number of popular macazines. 
1380 were selected. 

One word was omitted from each sentence in a way 
that yielded three treatments of sentence length, 
within which were four treatments of position of 
omission, within which were six treatments of word 
class of the omitted word. (179) 

Subjects were 24 second-semester freshmen enrolled at 
the University of Alabama. There were twenty 90 minute ses- 
sions lasting four, weeks. Only exact-word replacements were 
accepted. 



Conclusions » Among the conclusions weret 

1. The length, distribution, and grammatical struc- 
ture of context are all independently effective 
sources of constraint on words in sentences. 

2. The predictability of words belonging to a given 
word class is, in general, inversely related to 
the size of that class. . . . 

3. Increasing the context beyond 10 words does not 
increase predictability. The length at which con- 
text attains maximum effectiveness lies between 

5 and* 10 words 4 

4. A bilaterally distributed context exerts greater 
constraint than a totally preceding or totally 
following context of the same length. . . . (179) 
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AQUINO, MILAGROS. "THE VALIDITY OP THE MILLER-COLEMAN 
READABILITY SCALE.- READING RESEARCH QUARTERLY . If 
(1969). 3^2-357.1 ^ 



Purpose t The author reports an investigation to validate 
the Miller-Coleman passages calibrated for complexity, other- 
wise known as the Miller-Coleman Readability Scale * 

Principles, Conce pts, or Procedures : Fourteen adult subjects 
read six passages for six consecutive working days. One minute 
was allowed for each passage to be read. Subjects were then 
required to recall the passage orally or in writing. Correct 
noun, verb, adjective, and adverb replacements were scored. 

At the conclusion of this phase of the study, subjects 
were required to place the 36 passage cards in five stacks 
according to difficulty. Subjects then ranked each stack of 
cards for relative difficulty. 

Conclusions t Word-for-word recall and judged difficulty cor- 
related highly with both the bilateral and unilateral cloze 
aspects of the scale. 



^' ^' Millei^* and E. B. Coleman "A Set of 
Thirty-Six Passages Calibrated for Comprehensibility, * 
p. 61 of this thesis. 



BEARD t JACOB G. -COMPREHENSIBILITY OP HIGH SCHOOL TEXTBOOKS: 
ASSOCIATION WITH CONTENT AREA." JOURNAL OF READING . 11 
(1967 )f 229-23^. 



Purpose : The author investigated "... differences in com- 
prehensibility of textbooks associated with school subject 
matter content areas." (229) 



Principles f Concepts t or Procedures > Ten passages of 250 
words each were randomly selected from each of four areas: 
biology* chemistry, American government, and world history. 

Subjects were 250 tenth grade students in Tampa, Florida 
who were sampled from five ability levels according to verba?, 
scores received on the School and College Ability Test . 

Five forms of a cloze test were prepared for each pas- 
sage. Since every fifth-word deletions were used, every word 
was a restorable item in each form. Only exact replacements 
were scored correct. 

Comprehensibility was also measured by using the average 
number of words per T-unit. Each passage was also 

. . . analyzed to determine the extent of use of 
10 elements of expressional style: monosyllable 
words, sentence length, first person pronouns, 
second person pronouns, third person pronouns, 
different words, complex sentences, infinitive 
phrases, words beginning with the letter "i," and 
abstract nouns. (233-234) 



Conclusions : •'Small and insignificant differences were 
found for the means of the comprehensibility measures . . . 
(234) and for all the structural variables except "i^* words 
and infinitive phrases. 

It was concluded that the comprehensibility of 
prose used in current high school textbooks is, 
on the average, about the same for American 

fovernment, world history, biology, and chemistry. 
23^) 
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BLAKE, JAMES HERBERT. "CLOZE SCORES, AGREEIVIENT SCORES, AND 

APPROXIMATED EQUIVALENCE SCORES AS INDICES OF CONTEXTUAL 
CONSTRAINT." UNPUBLISHED PH.D. DISSERTATION, SYRACUSE 
UNIVERSITY, 1970. 



Purpose t Problems in indexing a language variable, contextual 
constraint, were considered in this study. The contextual con- 
straint of a position in connected discourse is the degree to 
which the words elsewhere in the discourse determine what word 
occupies the position. 



Principl es, Concepts, or Procedures ; Three indices were con- 
sidered: the cloze score, the agreement score, and the approxi- 
mated equivalence score. These are scores that can be calculated 
ftrom data obtained by means of a deletion-test item. 

The cloze score is computed according to the following 
formula t 

Cloze score = P^^ 

in which Pj^ is the relative frequency of the response identical 
to the deleted word. 

The agreement score is the ratio of the amount of agree- 
ment among the responses to a deletion-test item and the great- 
est amount of agreement possible. As a computational proce- 
dure, the agreement score is identical to the Shannon redun- 
dancy index. . . . 



The subjects were undergraduate history students v/ho par- 
ticipated in two testing sessions. During the first session 
they responded to a variety of deletion-test items. During 
the second session they responded to a variety of free-associa- 
tion-test items. The stimuli for these latter items were words 
that the subjects had offered frequently in response to the 
deletion- test items. 



Conclusions t The cloze score and the agreement score were 
compared with respect to detecting known differences in contex- 
tual constraint. Approximations to English were the sources 
of these known differences in contextual constraint. The 
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agreement score was found to be more sensitive than the cloze 
score to these differences. 

The cloze score and the agreement score were each used in 
attempts to detect differences in the contextual constraints 
within twenty-five -word sentences and the contextual con- 
straints within eleven-v/ord sentences. Regardless of the in- 
dex used, no differences were detected. It could not be de- 
termined whether there were in fact no differences or whether 
both indices were too insensitive to detect whatever differ- 
ences were present. 

The cloze score and the approximated equivalence score 
were compared with respect to estimating contextual constraint. 
Estimates were higher by small amounts when approximated equi- 
valence scores indexed contextual constraint than when cloze 
scores estimated contextual constraint. Even when contextual 
constraints were known to be very small, approximated equiva- 
lence scores provided higher estimates than cloze scores. 

The cloze score and "he approximate! equivalence score 
were each used to estimate the contextual constraints upon se- 
lected positions in an experimental passage. Scores exceeded 
a 0.100 criterion for a greater number of positions when 
approximated equivalence scores indexed contextual constraint 
than when cloze scores indexed contextual constraint. Thus, a 
greater number of positions were judged to be under substan- 
tial contextual constraint when approximated equivalence 
scores were used. 

It was concluded that when researchers must detect differ- 
ences in contextual constraint, the cloze score is not the most 
appropriate index. In such situations, the researcher should 
use an index more sensitive to differences in contextual con- 
straint. The agreement score apparently is more sensitive than 
the cloze score. In the future, however, other indices may 
prove even more sensitive than the agreement score. 

In addition, it was concluded that when researchers must 
detect even small amounts of contextual constraint, the cloze 
score is not the most appropriate index. The approximated 
equivalence score is more appropriate because it is less likely 
to underestimate contextual constraint. In the future other 
indices may prove to be even more aDpropriate than the approxi- 
mated equivalence score in such situations. 

Future research projects might involve a search for more 
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easily computed indices that have the desirable properties of 
agreement scores and approximated equivalence scores. In 
addition, future projects might use cloze scores, agreement 
scorest and approximated equivalence scores to predict the 
incidence of substitution-type word recognition errors. Pre- 
dictions about the words substituted and predictions about 
the effects of each substitution on comprehension might be 
made. Such predictions could be compared with actual reading 
performances.! ^ 



^Dlesertatton Abatracta International Ai Tha Hnman^-t-^ oo 
ana social Sciencaa (Ann Arbor, Michigani University Micro- 

Ji^lTTFiir^^Sr^^' PP* 5923-A, 592^f-A. (Order 

No. 71-10,892, 331 pages). 
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BORMUTH, JOHN ROBERT. "CLOZE TESTS AS MEASURES OF READABIL- 
ITY AND COMPREHENSION ABILITY." UNPUBLISHED ED.D. DIS- 
SERTATIONt INDIANA UNIVERSITY, 1962.1 



Purpose I The purpose of this study was to investigate the va 
lidity of cloze tests as measures of the readability of the 
passages from which they are made. Since the readability of 
a passage is defined by the amount of comprehension with 
which it is read, it was necessary to investigate three as- 
pects of cloze tests. These were (1) their validities as 
measures of comprehension ability, (2) their efficiencies 
when used for the purposes of discriminating among the diffi- 
culties of tests and the abilities of individuals, and (3) 
their validities as measures of the amounts of comprehension 
with which passages are read. 



Principles t Concepts, or Procedures : Nine passages were used. 
These were equally divided among three classes of subject mat- 
ters and three levels of difficulty. A 31 item comprehension 
test was written over each passage. Each test contained items 
measuring each of seven comprehension skills. By counting a 
subject's correct responses to the items measuring one skill 
in the entire set of tests, a measure of ability in that skill 
was obtained. Cloze tests were made over each passage by re* 
placing every fifth word with a blank until 50 items were ob- 
tained. Only when a subject could write in the blank the exact 
word deleted was his response scored correct. All tests were 
administered to three groups of 50 subjects each. A group was 
composed of children enrolled at one grade level. The grade 
levels of the groups were grades 4, 5, and 6. 



Conclusions I The findings supported the hypothesis that cloze 
tests are valid measures of comprehension ability. Scores on 
each of the nine cloze tests correlated with the scores on 
each of the seven tests of comprehension skills. Analysis of 
the variance of cloze scores showed that they were affected by 
the variables which affect comprehension scores. A similar 
analysis was applied to the scores of comprehension tests. 
The proportion of the variances due to each variable was found 
to be similar on the cloze and comprehension tests. All cor^- 
relations between cloze and comprehension scores on tests over 



See also John R. Bormuth, ''Cloze as a Measure of Readabil* 
ityt** Appendix. 
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the same passages were significant. The correlations between 
•^he totals of the comprehension and cloze scores reached .9^6. 

The findings supported the hypothesis that cloze tests 
are efficient when used for the purposes of measuring read- 
ability and comprehension ability. The difficulty values of 
the items on each test were distributed over the entire range 
of difficulties. The items had high correlations with the 
total scoros on the tests which indicated that they tended to 
be intercorrelated. When test reliabilities were estimated 
by the method of rational equivalence, the median reliability 
was .837. When reliability was estimated from correlations 
among tests over passages in the same class of subject matter, 
the medial reliability was .802. 

The findings supported the hypothesis that cloz& tests 
measured the readability of the passages in this study. The 
difficulty rankings of the cloze tests were correlated with 
the difficulty rankings of the comprehension tests over the 
same passages. All correlations were significant. The com- 
prehension test rankings were l^jss reliable than the cloze 
test rankings. When the difficulty rankings of the comprelien- 
81 on tests were taken from the scores of the total group, 
their correlations with the cloze test rankings by each croup 
ranged from .883 to .929.1 



„, ^pissertation Abstracts (Ann Arbor, Michigan 1 University 

5i**S;Si^"fA.^9^3^'x^'°^* 23. No. 11, pp. if218-if219. (Order No. 
I 63-2586, 205 pages). 
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BORMUTH, JOHN R. "OPTIMUM SAMPLE SIZE AND CLOZE TEST LENGTH 
IN READABILITY MEASUREMENT." JOURNAL OF EDUCATIO NAL 
MEASUREMENT . 2 (I965), 111-116': 



Purpose 1 The purpose of the study was . .to estimate 
the number of subjects and number of items required to 
attain various levels of precision in readability experi- 
ments involving cloze 1 sts." (Ill) 



Principlest Concepts, or Procedures 1 The procedure reported 
here is the same as that reported in "Experimental Applica- 
tions of Cloze Tests. "1 



Conclusions 1 "Decisions of optimum research design must 
take into account theoretical, statistical, and economic fac- 
tors." (115) The table of average standard errors developed 
as an adjunct to the experiment "... shows that error is 
reduced more by adding a given number of items than by add- 
ing the same number of subjects." (115) 



i 

I 



See page 8 of this thesis. 
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BORBtUTH, JOHN R. -READABILITYt A NEW APPROACH.- READING 
RESEARCH QUARTERLY , 1 (I966), 79-131. 



Purpose » "Five problems basic to the development of precise 
readability fc-Tnulae were investigated." (79) 

Princip les. Concepts, or Procedures ; The procedure reported 
here is the same as that reported in "Experimental Applica- 
tions of Cloze Tests. "1 

Conclusions 1 

1. Nonlinear correlation techniques are required in some 
readability formulae. 

2. Readability formulae can predict difficulty for the 
students at all levels of ability. 

3. Difficulties inherent in words, independent clauses, 
and sentences can be predicted by readability formulae. 

4. The high correlation between linguistic variables and 
passage difficulty (.93^) indicates that the validity of for- 
mulae based on linquistic variables can be improved, 

5» The development of more sophisticated linguistic 
variables will yield the greatest improvement in readability 
prediction. 



^See page 8 of this thesis. 
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BORMUTH, JOHN R. "NEV/ DATA ON READABILITY." FORGING AHEAD IN 
READING . EDITED BY J. ALLEN FIGUREL. PROCEEDINGS OF THE 
INTERNATIONAL READING ASSOCIATION. NEWARK, DELAWARE: 
INTERNATIONAL READING ASSOCIATION, 196?, 488-492. 



Purpose : The author describes recent research in readability. 



Principles. Concepts, or Procedures : 

1. Measuring the difficulty of reading materials is con- 
sidered first. Traditionally multiple choice tests have been 
used for this purpose. Because one can never be sure that he 
is not just measuring the difficulty of the test questions 
and because word, phrase, and sentence difficulties within the 
passage are thereby overlooked, multiple choice tests are not 
satisfactory measures. The cloze procedure, however, provides 
a valuable alternative, for the aforementioned difficulties 
are not existent therein. 

2. The measurement and description of language is next 
discussed. "Present investigators are probing more deeply 
into the question of what makes a word difficult to under- 
stand." (489) Both word length and morphological complexity 
have been shown not to be sources of difficulty. The fre- 
quency with which a word is used may be of significance. "The 
degree of intricacy of the grammatical relationships between 
the parts of a sentence . . is . .an important source 
of difficulty in understanding the sentence." (490) Syntactic 
depth, modifier distance, and transformational complexity are 
highly related to sentence difficulty. "Modern researchers 
are looking beyond the word and the sentence to find the fea- 
tures of language that operate over longer segments of text to 
influence comprehension." (491) 

3. The progressive development of readability formulae is 
outlined. An important finding has been that "... regardless 
of a person's reading ability, the same features of language 
that caused difficulty for him caused the same amount of diffi- 
culty for others." (491) Future research must examine trans- 
formations of words and also yield profiles of difficulty for 
each of the language features in a passage. 



Conclusions ! Because psychologists and linguists have de- 
veloped new tools and because of increased understanding of 
mathematics, rapid strides have been and will continue to be 
made in readability research. 
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BORMUTH, JOHN R. CLOZE READABILITY PROCEDURE . LOS ANGELES » 
CENTER FOR THE STUDY OF EVALUATION OF INSTRUCTIONAL PRO- 
GRAMS, UNIVERSITY OP CALIFORNIA, 196?. ^ 



Purpose t The research related to the cloze procedure as a 
measure of comprehension difficulty of v»ritten materials was 
reviewed. 



Principles, ConceptSt or Procedures i The characteristics, the 
validity, and the application of the cloze procedure are dis- 
cussed. Among the topics are thft following: 

1. Measurement of past-reading knowledge. 

2. Measurement of knowledge gain. 
. Measurement of passage difficulty. 
. Cloze test reliability. 

5» Designing the testing procedure. 

6. Deletion and scoring procedures. 

7. Test administration. 

8. Interpretation of scores. 



Conclusions i The cloze procedure yields results which are more 
valid than those available from readability formulae. The pro- 
cedure is applicable to a wide range of evaluation tasks. 



See al^o John R. Bormuth, "The Implications and Uses of 
the Cloze Procedure in the Evaluation of Instructional Pro- 
grams," Appendix* 
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BORMUTH, JOHN R., AND MACDONALD, 0. L. "CLOZE TESTS AS A MEA- 
SURE OP ABILITY TO DETECT LITERARY STYLE." READING AND 
INQUIRY . EDITED BY J. ALLEN FIGUREL. PROCEEDINGS OF 
THE INTERNATIONAL READING ASSOCIATION. NEV/ARK, DELAWARE: 
INTERNATIONAL READING ASSOCIATION, I965, 287-290. 



Purpose t Two hypotheses were tested. 

1. . . • there is a positive correlation betv/een 
subjects* scores on cloze t*?sts, and their scores 
on tests of ability to detect an author's style. 

2. . . . scores on the test of ability to detect 
the author's style . . . have a higher correlation 
with the scores on the cloze test given after the 
subjects . . . read the book than with the scores 
on the test given to the subjects before they . . . 
read the book. (289) 



Principles, ConceptSt or Procedures : Tests designed to measure 
the literary styles of Trollope and Steinbeck were constructed. 
Chosen were 100 sample passages of about 4o words each, all of 
which represented Trollope' s work. An additional 100 samples 
were drawn from the works of other authors. The 200 passages 
were typed on cards which were later shuffled. The subjects 
were 150 female college students who were required to read each 
passage and indicate which were written by Trollope. The same 
procedure was used with Steinbeck's writings. 

The subjects were given a clor.e test of 100 items made 
over Barchester Towers by Trollope before being assigned the 
book to read over a four week period. The author, his style, 
and the period were discussed in class. A second cloze test 
was given at the end of this period. The same procedure was 
used with respect to Of Mice and Men by Steinbeck, 



Conclusions I The first hypothesis was significant at the .01 
level and accepted, while the second hypothesis was not con- 
firmed. It may be confidently assumed that a reader's sensi- 
tivity to style is an important variable in determining how well 
the reader will perform on a cloze test. Further, subjects who 
have not read the materials from which cloze tests were made 
seem to do as well as those who have studied the materials. 
This latter finding seemingly contradicts earlier studies by 
Rankin, and Weaver and Kingston. 
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COVINGTON, RICHARD JOHN LEE. -AN ANALYSIS OF READABILITY OF 
THIRD AND FOURTH GRADE MODERN MATHEMATICS TEXTBOOKS 
USING THE CLOZE PROCEDURE." UNPUBLISHED ED.D. DISSER- 
TATION, UNIVERSITY OP CALIFORNIA, LOS ANGELES, I966. 



Purpose t The purpose of this study has been to employ the 
cloze procedure of test construction and evaluation in assess- 
ing the readability of two separate modem mathematics text- 
books, one a third grade textbook and the other a fourth grade 
textbook, both published by Science Research Associates. 



Principl es. Concepts, o: iedures t Six 250-word passages 
were taken from each te;. . >>k and words deleted on an every 
fifth word basis. In ad . "jion, three deletion patterns were 
used in which Form A of -h test deleted words starting with 
word one. Form B with woj three, and Form C with word five, 
making 50 deletions, A . - ndard length blank was used for 
each deletion. 

The textbook passages were divided among three test 
types: word problems, statements of directions which tell 
pupils to perform some behavior in arithmetic activities, and 
statements of instructions which present presumably new mathe- 
matical concepts. 

Pupils were divided into three ability groups. The first 
group included pupils on the California Test of Mental Ma tu- 
rity publisher's standardized stanines 1, 2, and 3. The 
second group from stanines 4, 5, and 6t and the third ability 
group from stanines 7, 8, and 9. Group two indicates pupils 
of average ability and group three above average. Group one, 
because of extremely small N*s, was dropped from statistical 
analysis. 



Conclusions i Assessment of readability was based on two mea- 
surements. The first was a count of those pupils* tests scor- 
ing 17 or more correct or 16 or less correct on each form and 
in each ability group. The other measure was the mean correct 
responses for each form, each test, and by ability gr/oup. 

On the basis of the assumptions for the study, third 
grade second ability group pupils did not meet criterion scores 
on any tests. Third grade third ability group and all fourth 
grade pupils met or exceeded criterion scores only on word 
problems. 



Therefore, by inference, the third and fourth grade 

textbooks Se^o? read, 
lems.l pupils, except for word prob- 



, ^Diesertation Abstra cts A» ghe Humanities / md SffoAa-j 
Scj-ences (Ann Arbor, Michigan: University Microfilms, I067), 
Vol. 27, No. 10. (Order No. 67-^509, 108 pages). 



ELLEY, WARWICK B. "THE ASSESST-IENT OF READABILITY BY NOUN FRE- 
QUENCY COUNTS." READING RESEARCH QUARTERLY , if (I969), 411- 
427. 



Purpose ! The author describes the assessment of readability 
using noun frequency counts. 



Principles. Concepts » or Procedures ! Ten passages of approxi- 
mately 150 words were devised. Every sixth word was deleted. 
Subjects were seventy secondary school pupils. Replacements 
of verbs, pronouns, adjectives, adverbs, conjunctions, and 
prepositions were superior in percentage scores to noun re- 
placements • 

These results and similar findings by other researchers 
prompted the author to consult teachers' and pupils' ratings 
as criterion measures. Noun frequency levels were consistent- 
ly better predictors of difficulty. 



Conclusions! The author recommends further investigation of 
the use of cloze scores as criterion measures. 
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FROELICH, DONALD MAX. -A COMPARISON OP TWO METHODS OF ASSESS- 
ING TEXTBOOK READABILITY OF SELECTED COLLEGE LEVEL ELEC- 
TRONICS TEXTBOOKS." UNPUBLISHED ED.D. DISSERTATION, 
UNIVERSITY OF MISSOURI - COLUMBIA, I97O. 



Purpose t The purpose of this study was to compare the cloze 
readability technique with the Flesch Reading Ease Formula to 
ascertain the effectiveness of each in assessing the readabil- 
ity of selected college level electronics textbooks. The com- 
parison was made in terms of student achievement on a multiple 
choice test over a passage selected from a college level elec- 
tronics textbook. 



Principles, Concepts, or Procedures » The study was conducted 
in three state colleges in Missouri and involved students en- 
rolled in a basic electronics course in the Department of Indus- 
trial Education in each school. 

The Flesch Reading Ease Formula was chosen for comparison 
with the cloze procedure in this study because of its general 
acceptance by textbook publishers and others as a convenient 
readability assessment technique. 

Pearson product-moment correlations were computed to show 
the relationship between the cloze tests and the achievement 
test. T-tests of the difference between two means for corre- 
lated samples and for independent samples were computed to 
analyze the difference of the measures at both levels of reada- 
bility. 

A criterion cloze test score was employed to assess the 
written material as acceptable or not acceptable in comparison 
with reading abilities of the students. 



Conclusions t Cloze test scores identified the readability 
levels of written technical material in a manner more consis- 
tent with the abilities of college students to comprehend the 
material as assessed by scores on an achievement test over the 
written technical material than the readability level assess- 
ment made by application of the Flesch Reading Ease Formula . 

An analysis of the mean cloze test scores and of the mean 
achievement test scores revealed that although the Flesch Read - 
ing Ease Formula rated the technical material at the ninth and 
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at the fifteenth grade levels of readability, the ability of the 
students to comprehend the written material, as assessed by the 
results of the achievement test, was not predicted by the reada- 
bility levels as assessed by the Flesch Reading Ease Formula . 

The Flesch Reading Ease lormula did not identify the reada- 
bility of written technical material in a manner that was con- 
sistent with the ability of the college student to comprehend 
the material as assessed by an achievement test over the same 
naterial* 

The results from an analysis of the mean scores of the 
achievement test revealed that no significant difference existed 
between the two levels of readability of the written material 
assessed by the Flesch Rea ding Ease Formula . In addition, the 
analysis of the achievement test scores revealed that there was 
a significant difference in the ability of the students to com- 
prehend the written material taken from the first one-half and 
from the second one-half of the selected textbook passage. The 

f^^f^^H-f^!'^^"^^?^^?.^^"^"!! ^^^^^^ *° identify the difference 
in content difficulty of the material in each one-half of the 
selected textbook passage. 

''^A readability procedure in assessing 

the readability of college level electronics textbooks in terms 
of student comprehension of the material may be considered to be 
a reliable technique. 

Comparison of the results in analyzing the difference of 
the mean cloze test scores over both halves of the selected text- 
book passage and the difference of the achievement test scores 
oyer both halves of the selected passage indicated that the 
cloze readability procedure and the achievement test were in 
agreement in assessing the written technical material selected 
from the college level electronics textbook. 

In view of the evidence presented in this study, it is 
apparent that factors in addition to those included in the 
Flesch Reading Ease Formula should be included in the assess- i 
ment of the readability of college level electronics textbooks. 



r„ pf;?^r^^^^o» Abstracts Internati o nal Ai The Humanities 
and Social sci^ices (Ann Arbor, Michigani University Micro- 

I65" ) ®' ^' No. 71-3329, 
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PROESE, VICTOR. "CIOZE READABILITY VERSUS THE DALE-CHALL FOR- 
MULA." PAPER PRESENTED AT THE ANNUAL MEETING OF THE IN- 
TERNATIONAL READING ASSOCIATION, ATLANTIC CITY, NEW JERSSl' 
APRIL 19-23. 1971. 



Purpose t The validity of the Dale-Chall readability ratings for 
sixth-grade science textbooks when compared to an independent 
criterion of language difficulty expressed in cloze units was 
examined. 



Principles. Conce pts, or Procedures ; The Canadian Lorge-Thorn - 
Test and the Canadian Test of Basic Skills . Vocabulary 
and Comprehension subtests, were administered to 366 sixth gra- 
ders. Mean IQ score was 102, while mean scores for vocabulary 
and comprehension were 6.19 and 6.15. respectively. Passages 
from 12 science textbooks were subjected to the cloze technique 
and administered to the subjects. 



Conclusions i Findings revealed that (1) the 12 cloze passages 
yielded a reliability coefficient of .79» (2) cloze scores cor- 
related from .55 to .85 with the intelligence measure » (3) 
cloze scores correlated from .64 to .86 with vocabulary, and 
from .52 to .85 with comprehension 1 (4) the cross-validation 
coefficient of .90 obtained by Dale and Chall and the cross- 
validation coefficient of .29 obtained in this study are sig- 
nificantly different beyond the .01 level of confidence. Major 
conclusions were (1) that the cloze tests are reliable measures 
of language difficulty and (2) that the Dale-Chall Readability 
Formula is not a valid measure of sixth-grade science textbook 
materials when the cloze procedure is ^used as a criterion. Re- 
ferences are included. 1 



^Regearch in Education (Washington. D.C. 1 United States 

/SS*^®2J/''}S*^"« Office. 1971). Vol. 6. No. 10. p. 76. 
lED 051 975, 12 pages). 
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PRY, EDWARD B. THE READABILITY GRAPH VALIDATED AT PRIMARY 
LEVELS . CAMBRIDGE, MASSACHUSETTS! COMPUTER ASSISTED 
INSTRUCTION LABORATORY, GRADUATE SCHOOL OP EDUCATION, 
HARVARD UNIVERSITY, I969. 



Purpose t The validity of the Pry Readability Graph was com- 
pared with a readability formula, the cloze technique, and 
oral reading. 



Principles. Concepts, or Procedures : Passages from seven pri- 
mary level books were ranked by the Fry Readability Graph , the 
Spache Readability Formula , and oral reading error sjores, as 
well as the cloze procedure. 

In the latter instance thirty second and third grade 
pupils read aloud from the seven book passages from which 
every fifteenth word was deleted if it was classified as a 
noun* verb, adverb, or adjective. Words of these classes 
nearest the fifteenth were deleted if the criterion could 
not be met. Scores were also obtained for the oral reading 
performance of the children when the words were not deleted. 



Conclusions t All four methods ranked the passages well. "In 
my opinion the cloze method was the most accurate and made the 
finest distinctions." (6) 
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GALLANT, RUTH MARGARET PRANCES. "AN INVESTIGATION OF THE USE 
OF CLOZE TESTS AS A MEASURE OF READABILITY OF MATERIALS 
FOR THE PRIMARY GRADES." , UNPUBLISHED ED.D. DISSERTATION, 
INDIANA UNIVERSITY, 196k A 



Purpose t This study dealt with two related problems, (1) the 
reliability and validity of cloze tests as a measure of reading 
comprehension for pupils in the primary grades, and (2) the 
effect of increased sentence length on the readability of ma- 
terials designed for use with these pupils. 



Principl es, Concepts, or Procedures : The procedure for problem 
one involved the rewriting of the paragraph section of the 
Metropol itan Reading Achievement Tests for grades one, two, and 
three. A modified form of cloze procedure was devised for use 
with grade one. In regular cloze procedure, every fifth word 
is replaced by a blank line on which the subject writes his re- 
sponse. In the revised form used with grade one, three multiple- 
choice responses were provided for every deleted fifth word in 
the passages. 

The cloze tests and a comparable form of the Metropolitan 
Test were administered to 273 pupils. Pearson product-moment 
correlation was used to determine if the rankings of pupils 
on the cloze test corresponded with thi- ? ankings on the stan- 
d^dized achievement test. Within each grade level, the cor- 
relation obtained for the boys was compared to that of the 
girls. A two-way analysis of variance was used to test the 
significance of the differences between the cloze test scores 
when the pupils within each grade were subdivided by sex and 
classified by tested reading achievement levels. The analysis 
was calculated for second and third grade scores, each grade 
level handled as a separate group. 

For the second problem, two sets of passages were writ- 
ten, each consisting of five levels of reading difficulty as 
measured by the Spache readability formula. The revised 
passages were similar to the basal passages in number of words 
per passage and difficulty of vocabulary. Sentence length had 
been increased in the revised passages so that the Spacho 
readability level ranged from three months to one year higher 
than that of the basal passages. Cloze tests over both sets 
of passages were administered to the 273 pupils. Differences 



See also Ruth Gallant, "Use of Cloze Tests as a Measure 
of Readability in the Primary Grades," Appendix. 
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in mean cloze performanci- were tested for significance of each 
grade level. 



Conclusions J Findings were as follows? the correlations be- 
tween the cloze tests and the standardized reading tests for 
each grade in total and for each grade subdivided by sex were 
significant. The analysis of variance corroborated the va- 
lidity of cloze scores as a measure of reading comprehension. 
The effect of sex on cloze test performance was shown to be 
significant for the second and third grade scores. Although 
the relationship of cloze performance to the standardized test 
scores was essentially the same for both sexes, the analysis 
indicated that it was taking place at a higher level for the 
girls. The reliability coefficients for the cloze tests ranged 
from .90 to .97. 

Differences in mean cloze test performance for the basal 
and revised passages were significant at the .01 level for 
both sexes and the total groups in grades one and two. 

At the third grade level the difference between the means 
was not significant for the boys on either set of scores, exact 
or substitute. The difference was significant at the .05 level 
for the exact scores of the girlss and the total exact scores. 

It was concluded that cloze tests were valid and reliable 
measures of readability for the primary grades. Increase in 
sentence length appeared to increase the difficulty level of 
materials for first and second grade pupils, but this increase 
did not hold true for all subgroups of grade three. I 



Dissertation Abstracts (Ann Arbor, Michigan i University 
Microfilms, 1905;. vol. 25. No. 11, pp. 6431-6432. (Order No. 
65-2370, 152 pages). 
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HOUSKA, JOSEPH THOMAS. "THE EFFICACY OF THE CLOZE PROCEDURE 
AS A READABILITY TOOL ON TECHNICAL CONTENT MATERIAL AS 
USED IN INDUSTRIAL EDUCATION AT THE HIGH SCHOOL LEVEL." 
UNPUBLISHED ED.D. DISSERTATION, UNIVERSITY OF ILLINOIS 
AT URBANA- CHAMPAIGN, I97I. 



Purpose I To ascertain the efficacy of the Cloze Procedure as 
a readability tool on technical content material. 



Principles. Concept s, or Procedures : Nine technical content 
passages (three from each field) were dravm from the automo- 
tive, woods, and electronics industrial education fields. Each 
passage was approximately 350 words in length. An assessment 
of readability of each passage was made by use of the Flesch 
Reading Ease Formula. Then, by manipulation of the two factors 
of the Flesch formula, the three passages of each technical 
field were re-written to 7th, 10th, and 13th grade levels of 
readability. A cloze test and a 22-item comprehension test was 
developed over each passage. The cloze test was of the every 
5th word deletion type while the 22-item comprehension test con- 
sisted of four measures of specific comprehension skill, i.e., 
meaning of technical and non-technical vocabularies, recogni- 
tion of factual statements, and relationships. 

The subjects (N-99) were obtained from the larger indus- 
trial education population (N=223) on the basis of their com- 
pleting all nine cloze and comprehension tests and having 
available standardized measures of IQ and reading achievement. 
A t test between means of the sample population and the larger 
population, on IQ and reading achievement test scores, indi- 
cated the study population to be representative of the larger 
population. Furthermore, on the basis of the standardized 
reading achievement scores, the sample population was divided 
into three groups of high, medium, and low in reading ability. 

The administration of the tests was conducted in the 
regular classroom meeting. The cloze test was presented first, 
before the subjects had read the passage. Eleven days later, 
the cubjects read each passage and responded to the 22-item 
comprehension test over the passage. Analysis of the hypoth- 
eses of this study was based on the results of these two tests. 



Conclusions t Split-half test reliabilities were computed for 
each of the nine comprehension and cloze tests, and when cor- 
rected for attenuation by the Spearman-Brown Prophecy formula. 
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yielded reliabilities from .58 to .88 for the comprehension 
tests and ,73 to .92 for the cloze tests. Pearson r correla- 
tion coefficients were computed between cloze and comprehen- 
sion tests over the same technical content passage (r=.383 to 
.609). corrected for attenuation)? between cloze tests and 
measures of specific comprehension skills (r=.115 to .497 )i 
and between cloze tests and IQ (r=.29 to .52) and cloze tests 
and reading achievement (r=:.27 to .57). All were significant 
at the .05 level. 

Spearman rho rank order correlation coefficients were 
computed between comprehension and cloze tests rank ordering 
°£iJ?! ^/"^ passages and across levels of students* reading 
ability (rhos = .86 to .98) » between cloze test and Flesch 
Reading Ease Formula rank ordering of the three passages of 
each technical field, (rhos - .50 to 1.00) and between the 
comprehension and cloze tests rank ordering of the three dif- 
ferent technical fields used in this study (rho = l.OO). A 
siraple one-way analysis test, followed by a Newman-Keuls test, 
was computed across levels of reading ability for each cloze 
test to verify if significant differences existed in the rank 
oracring process by the different ability groups. All P ratios 
were significant at the .05 level. 

The cloze procedure, when used on technical content ma- 
terials, was demonstrated toi 

1. identify the relative readabilities of the passages 
similar to the comprehension test technique i 

2, identify the relative readabilities of the passages 
similar to the Flesch Reading Ease Formula i 

3» discriminate between readers of varying reading 
abilities? ^ 

4. identify which technical content fields were rela- 
tively more readable? 

5. relate, with low correlations, with standardized 
measures of students* abilities. 1 



. „ Dissertation Abstra cts International At The Humanities 
and Social Sciences (Ann Arhnr^ M^nh^gan. University Micro- 

ll^^t'cn^^Jil* ^ol\32. No. 8, pp. if500-A, ^f501-A. (Order No. 
72-6957» 199 pages). 
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JEFFERSON, GEORGE LEE, JR. -LEXICAL AND STRUCTURAL ITEMS AS 
PREDICTORS OF READABILITY FOR HIGH AND LOW ABILITY 
READERS." UNPUBLISHED PH.D. DISSERTATION, UNIVERSITY 
OF GEORGIA, 1969.^ 



Purpose » This study is an attempt to clarify the use of cloze 
techniques in the measurement of reading comprehension and of 
written language difficulty. 



Principles, Concepts, or Procedures » The three variables 
tested were Reading Ability, Readability, and Deletion Type. 
The deletion categories were nth (every-fifth word), lexical 
(nouns, main verbs, adjectives), and structural (the tradition 
al parts of speech not categorized as lexical). These three 
kinds of deletions were made over each of the three passages 
which had been constructed from easy, middle difficulty, and 
hard reading material. The passages used were those which 
Bormuth (1966) ranked for difficulty using averaged nth unit 
forms over each passage. 

Pour hundred and sixty-six subjects, eighth through 
twelfth grades were stratified into three reading ability 
levels, and randomly assigned to one of nine treatment com- 
binations within each reading ability level. 



Conclusions t The data were analyzed by a three-way analysis 
of variance, based on assumptions of fixed effects model. 
There were significant main effects of reading ability and of 
deletion types. There was one significant interaction between 
deletion types and reading difficulty. This was not predicted 

The findings of this study strongly suggest that the 
cloze is potentially a strong research tool in the study of 
language and reading, but at present it is not a highly valid 
measure of reading comprehension or of passage difficulty. 
The significant differences among the three deletion types 
show that the language categories in this study represent at 
least two major distinct linguistic variables, and the lexi- 
cal and structural units operate in basically different ways. 



See also George L. Jefferson, Jr., "Lexical and Struc- 
tural Items as Predictors of Readability for High and Low 
Ability Readers,** Appendix. 
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The significant interaction between deletion type and 
readability strongly urges that the use of nth word cloze 
tests, averaged across a passage, does not reflect the essen- 
tial differences between content (semantic meaning) and 
structural (relationship meanings) units in the language. 
And further, no meaningful estimate of comprehension or pas- 
sage difficulty may be made from averaged nth unit deletion 
scores. The use of other linguistic variables rank order 
the passages in contradictory ways from the nth-unit averaged 
score ranking. 

The results of this study, using random assignment of 
subjects and non-repeated measures, suggest a need for careful 
experimental manipulation of the language variables which cor- 
relational techniques have pointed out. The kind of design 
and the type of statistical treatment employed need careful 
scrutiny if language experiments with the cloze are to make 
useful contributions to language research. ^ 



^Diasertation Abstracts International Ai The Humanities 
and Social Sciences (Ann Arbors Michigan « University Micro- 
films, 1970), Vol. 30, No. 12, p. (Order No. 70-10,200, 

pages). 
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KUIM, GERALD. "MEASURING THE READABILITY OP ELEMENTARY ALGEBRA 
USING THE CLOZE TECHNIQUE." PAPER PRESENTED AT THE ANNUAL 
MEETING OP THE AMERICAN EDUCATIONAL RESEARCH ASSOCIATION. 
NEW YORK, N. Y., PEBRUARY 4-?, 197I. ' 



Purpose t The relationship to readability of ten variables 
characterizing structural properties of mathematical prose was 
investigated m elementary algebra textbooks. 

Principles, Concepts, or Procedures » Readability was measured 
by algebra students' responses to two forms of cloze tests. 
Linear and currilinear correlations were calculated between 
each structural variable and the cloze test. 

Conclusions t The results indicated that explanatory material, 
sentence length, percentage of mathematical symbols and per- 
centage of difficult words had significant linear correlations 
with readability. In illustrative material, percentage of 
mathematical symbols and percentage of mathematics vocabulary 
had significant linear correlations with readability. Depar- 
tures from linearity wjre significant for sentence length and 

sentences in explanatory material, 
and percentage of difficult words in illustrative material. 
ZNot available m hardcopy due to marginal legibility of origi- 



^Research in Education (Washington, D.C. t United States 
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IISKE, WILFRED WALLACE. "THE CLOZE PROCEDURE FOR DETERT^INING 

READABILITY OF ENCYCLOPEDIA MATERIAL FOR ELEMENTARY SCHOOL 
PUPILS.- UNPUBLISHED ED.D. DISSERTATION, UNIVERSITY OF 
MARYLAND, 1968. 



Purpose t The purpose of the study was (1) to employ the cloze 
procedure of test construction and evaluation in assessing the 
readability of selected juvenile encyclopedia material for 
children in grades four, five, and six, and (2) to compare the 
results of cloze evaluation with readability formula grade - 
placement levels of the same material. 



Principles. Concepts, or Procedures t Fifteen encyclopedia ar- 
ticles corresponding to social studies and science topics 
studied in grades four, five, and six were selected at random 
from the 1967 edition of the World Book . Fifty-item cloze tests 
were constructed on the beginning, middle, and ending sections 
of each article. 

The forty-five tests were assigned randomly to 1,199 pupils 
drawn at random from the total fourth, fifth, and sixth-grade 
population in two public school districts in South West Michi- 
can. The tests were administered by the classroom teachers in 
March* I968. Mean cloze scores were calculated for each grade 
and each article. 

Grade -placement levels were estimated for each selected 
encyclopedia passage by the application of the Yoakan and 
Dale-Chall readability formulas. 



Conclusions t To fulfill the purpose of the study, answers were 
sought for two major questions and two sub-questions. 

!• Does readability as measured by cloze procedure indi - 
cate th?^ t selected materials from the World Book Encyclopedia 
are read able for children in grades four, five, and six ? 

A readability criterion of 75/75 was set by this study, 
i.e., seventy-five percent of the pupils in a grade were re- 
quired to reach a minimum cloze score corresponding to seventy- 
five percent correct responses on a multiple-choice comprehen- 
sion test. According to the criterion, the select ?d reference 
materials were not readable for the population te.^sd. The 
pupils that were successful in reaching the minimum (twenty- 
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two percent of the total population) had a mean IQ (Lorge- 
Thorndike) of 11^ and a mean reading achievement level (Stan- 
ford) of 1.4 grades above the mean reading achievement level 
of the total population. 

Sub-Que3tions one (a) and (b) asked whether there were 
significant differences among and within the selected encyclo -- 
pedla articles . Earlier research had indicated a wide range 
of grade-placement levels among this type of material. Pub- 
lishers of World Book claim that they adapt longer articles to 
a wide range of readers by lowering the readability difficulty 
of the beginning sections. No significant differences (two- 
way analysis of variance test, p < .01) were found among the 
mean cloze test scores of the fifteen articles. Significant 
differences (p < .01) were found within articles. Two-way 
analysis of variance test on the mean reading achievement 
levels showed no significant differences in reading achieve- 
ment among the groups completing the cloze tests on the vari- 
ous articles (p < .01). 

2. Does readability of selected World Book Encyclopedia 
material as indicated by cloze test results correspond with 
the grade-placement level of the same material as indicated by 
readability formulas ? In answer to this question, Pearson 
Product-Moment correlation coefficients were calculated be- 
tween cloze test results and fonnula grade -placement levels 
according to Dale-Chall and Yoakam readability formulas. A 
negative correlation was expected since higher grade-place- 
ment levels should result in lower cloze scores. Significant 
correlations (p < .01) of from -.58 to -.70 were found for 
middle and ending sections of articles, but not for beginning 
sections. The following conclusions resulted: 

1. Only the more able readers were able to cope with the 
selected World Book Encyclopedia (196? edition) reference ma- 
terials. 

2. The readability difficulty among the selected articles 
does net vary to a significant extent. 

3« The claim of the publishers of World Book that the 
readability difficulty increases within the total article was 
substantiated. 

k. Cloze procedure used in evaluating encyclopedia mate- 
rial substantiated the claims of readability research that 
cloze tests are reliable and valid for measuring readability 
of prose passages* 
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5* There were some significant correlations between 
cloze test results and readability formula grade placement 
levels. The correlations were not high possibly due to the 
limitations of the readability formulas and the different 
approaches used. Cloze procedure seems to follow more con- 
sistently the actual difficulty of the reading material. 1 



^Dissertation Abstracts At The Humanities and Social 
Sciences (Ann Arbor. Miohj gani University Microfilms, 19^9), 
Vol. 29, No. 12, Part 1, pp. ^189-A, WO-A. (Order No. 
69-9590, 160 pages). 
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MACGINITIE, WALTER HAROLD. "CONTEXTUAL CONSTRAINT IN ENGLISH 
PROSE." UNPUBLISHED PH.D. DISSERTATION, COLUMBIA UNI- 
VERSITY, 1960.1 



Purpose t Restorations of words and groups of words omitted 
periodically from English prose were studied as indicators of 
the way in which the choice of words is determined by context. 



Principles. Concepts , or Procedures : Since this form of the 
completion method has received extensive recent use with little 
recognition of many similar past applications, some of the more 
important developments in the history of the completion method 
were outlined. Previous developments in the study of language 
redundancy were also described. 

The patterns of omission which were usad permitted com- 
parison of the predictability of <;iven morels when different 
amounts of context were removed as periodic omissions in para- 
graphs. The usefulness of various criteria of correct predic- 
tion was studied in terms of frequency and reliability, and, 
as a result of this evaluation, two different criteria were 
chosen for use in the analysis of the data. Restorations were 
counted correct in one case only if they were exact restitu- 
tions of the original words, and, in the other case, all ra- 
tionally and grammatically acceptable restorations were counted. 

Words were restored in two descriptive paragraphs differ- 
ing in style and difficulty. Results, based on different sub- 
jects, were substantially the same for both paragraphs. Each 
different set of omitted words was restored by 20 different 
college students. 



Conclusions t A comparison of the restorations in the different 
omission patterns led to the following results: (1) There was 
5?^v®^H?i® <ii^'ference in difficulty of restoration when every 
24tn, 12th, or 6th v/ord was omitted, but omitting every 3rd 
word did make restoration more difficult. (2) When words were 
omitted in pairs, there was no reliable difference in diffi- 
culty of restoration, regardless of whether 22, 10, or only k 
words of context were left between each omitted pair. (3) 

/see also Walter H. MacGlnitie, "Contextual Constraint in 
English Prose Paragraphs," Appendix. 
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Words omitted in groups of four were more difficult to restore 
than words omitted in pairst and pairs were in turn more dif- 
ficult to restor^^ than single wordn. (4) Omitting an adjacent 
word made restoration more difficultf but it made no difference 
whether the additional omitted word preceded or followed the 
word to be restored • When each omitted word was scored sepa- 
ratelyt the above results were obtained regardless of whether 
all acceptable restorations were counted correct or whether re- 
turn of the original word was required. When each group of 
adjacent omitted words was scored as a unitf the above results 
were also obtained for both scoring criteriat except that in- 
creasing size of omitted word-group had little effect on the 
number of exact plus acceptable restorations. 

These findings were interpreted as indicating that con- 
textual constraints upon words in English prose decline 
rapidly with increasing distance of the context and that con- 
text beyond about five words has little effect on word choice. 
Some implications of this conclusion for the relation of con- 
text to understanding were discussed. 

A consideration of the relation of context to the ability 
of subjects to supply a word which is both rationally and gram- 
matically acceptable in the rest of the passage suggested that 
neither the form nor the content of written English may be 
much constrained beyond about five words and that units in 
which thoughts are composed may seldom be greater than this 
length. 1 



'' 'Dig^sertation Abstracts (Ann Arbor, Michigan! University 
Microfilms, I960), Vol. 21, No. 1, pp. 126-127 • (L. C. Card 
No* Mie 60-2020, 171 pages). 
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MILLER, G. R., AND COLEMAN, E. B. "A SET OF THIRTY-SIX PROSE 
PASSAGES CALIBRATED FOR COMPLEXITY." JOURNAL OF VERBAL 
LEARNING AND VERBAL BEHAVIOR . 6 (196?) t 851-85^*. 



Purpose I A set of prose passages was calibrated for complexity 
by means of the cloze procedure. 



Principles, Concepts, or Procedures i Thirdly -six passages 
drawn mainly from Standard Test Lessons in Reading were altered 
so that each contained exactly 150 words and ranged in diffi- 
culty from first-grade to technical prose. For each passage 
three types of cloze tests were constructed. 

The first utilized every-fif th-word deletion. Five forms 
were constructed, each beginning with a different deletion so 
that each word became a cloze item eventually. Six booklets 
of six tests each were compiled, alternating easy and difficult 
passages* 

The second type of cloze test allowed the subject to use 
all the constraint in a passage to determine the deletion, for 
150 forms were made with only one deletion in each. 

The third type demanded that the subject predict each of 
the 150 words beginning with the first. Each correct word was 
revealed after a response had been made. 

Subjects were k79 college students. The first cloze test 
had time limits. Correct exact replacements were accepted as 
well as synonyms and form classes. Subjects given test two 
were allowed unlimited time but had to replace the word exactly. 
In test three a new word was exposed every seven seconds. Only 
exact replacements were scored correct. 



Conclusions i 

1. The correlation of .99 between the weighted scores and 
the exact replacement scores in test one indicates that the 
simpler method of accepting only exact replacements is a valid 
and reliable one. 

2. Test three yielded the lowest percentage of correct 
responses and test two» the highest. 
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3. All three tests ranked the passages for difficulty in 
approximately the same manner* 

4'. The lack of increase in correct responses from word 
20 to word 1^0 in test three indicates that the responses are 
constrained very slightly, if at all, by words from other 
sen tences« 
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RENTEL, VICTOR MICHAEL. -FORM CLASS AND WORD LENGTH AS IN- 
DICES OF THE DIFFICULTY OF PREDICTING CLOZE ENTRIES IN A 
SAMPLE OP CONTINUOUS PROSE." UNPUBLISHED PH.D. DISSER- 
TATION, UNIVERSITY OF SOUTH CAROLINA, I969. 



Purpose : The study examined the difficulty of predicting four 
categories of words at three levels of word length on a cloze 
test of reading comprehensions. 



Principles. Conc epts, or Procedures > Grammatical classification 
was based on that of C. C. Fries with Form Class I roughly cor- 
responding to nouns, pronouns, and nominalizationsi Form Class 
2 to verbs I Form Clads 3 to adjectives? and Function Words to 
those words not capitalized in titles. Category limits for 
word length were defined by letters per word (Z-k^ 5-7, 8-I6). 
One hundred and fifty subjects were selected on a convenience 
basir from among juniors and seniors majoring in education en- 
rolled at both the University of South Carolina and the Univer- 
sity of Tennessee. A selection of 5t218 words of continuous 
prose from an essay entitled "How to Be an Employee" comprised 
a controlled (Plesch Reading Ease Formula - .69) language 
sample . 

Scores representing the difficulty of each grammatical 
category, each word length category, and the combination of 
Doth were compared using a multivariate analysis of variance 
for a repeated measures, multif actor experiment. Data analy- 
sis was performed by means of a computer program developed 
specifically for this study for use on the IBM 7040 computer. 
The program made overall tests on within-subjects effects 
through the use of Hotelling's t2 statistic, a multivariate 
analogue of the square of t. All differences were significant 
beyond the .005 level. 



Conclusions t Analysis indicated that as words increased in 
length, the difficulty of predicting their occurrence in a 
passage increased significantly across ?j1 language categories 
but not uniformly so. Form Class 3 appears least affected by 
increasing word length and more significantly difficult to 
predict than were other categories. But for words over seven 
letters long. Form Class 2 was slightly more difficult to pre- 
dict than Form Class 3t and both were significantly more dif- 
ficult to predict than was Form Class 1, Significant inter- 
actions occurred between word length and Form Class categories. 
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Typically, these interactions were wholly the result of varia- 
tions in the differences between categories. Significant in- 
teraction effects were mainly accounted for by the difficulty 
* ^osed on prediction by Form Class 3. For all categories of 
words over seven letters in length, length appeared to take 
precedence as a source of difficulty and was affected only 
slightly by variation in Form Class. 

Warnings against generalization from these results both 
to other levels of passage difficulty and to other subiects 
were stressed. 

Appendices include raw cloze test scores, lists of words 
deleted in each category, a sample cloze test, summary source 
tables, a description of the nonprofile data analysis, illus- 
trative scatter plots, and a table of test reliabilities for 
each of the eleven categories. 1 



^ „ dissertation Abstract s International A» The Humaniti es 
ftnd Social, Sciences {Ann Arbor, Michigan « University Micro- 
fiUns, 1970), Vol. 30, No. 10, p. i^285-A. (Order No. 69- 
20,113, 138 pages). 
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TAYLOR, WILSON L. "•CLOZE PROCEDURE*; A NEW TOOL FOR MEASUR- 
ING READABILITY." JOURNALISM QUARTER LY, 30 (1953) t ^1^- 



Purposes : 

In Experiment One, the author sought to determine if cloze 
scores would "rank" passages taken from the writings of Boswell, 
Huxley, and James as did the Flesch and Dale-Chall formulae. 

In Experiment Two, the author hypothesized that 

the results of Experiment One would be validated. 

2. the readability order of eight passages taken from 
the writings of Caldwell, Stein, and Joyce would be 
predicted by the rank order of the cloze scores given 
them by a panel of subjects. 

3. the cloze procedure would handle materials either 
or both the Flesch and Dale-Chall formulae coulc' not. 



Principles f Concepts, or Procedures : 

Experiment One: Three passages were adminis'^cred to 2^ 
college juniors and seniors. All were approximately 175 words 
in length and were mutilated by three systems. Scores were 
computed on the basis of exact-word and synonym replacement. 
Pilot studies were run in advance. 

Experiment Two: Eight passages were administered to 72 
subjects each of whom completed two — an easy one and a harder 
one. Other procedural aspects were similar to Experiment One. 



Conclusions : 

Experiment One: 

1. Cloze scores consistently ranked the passages as 
did the formulae. Qualitatively the three mutila- 
tion systems yielded the same results. Quantitative- 
ly, however, there were some differences. Exact- 
word and synonym scoring yielded virtually identical 
results. 



Experiment Two: 

!• The results of Experiment One were validated • 
2. The ranking given by the panel almost perfectly 
predicted those given subjects in the experiment. 
3» Cloze was superior to either of the formulae 
in predicting readability. 

Though the traditional formulae are reasonably accurate 
and reliable and do possess a number of advantages over the 
cloze procedure, certain language elements are not handled as 
well by the former as the latter. 
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TAYLOR, WILSON LEWIS. "APPLICATION OF 'CLOZE* AND ENTROPY 

MEASURES TO THE STUDY OF CONTEXTUAL CONSTRAINT IN SAMPLES 
OF CONTINUOUS PROSE.". UNPUBLISHED PH.D. DISSERTATION. 
UNIVERSITY OP ILLINOIS, 195i|.. 



Purpose t Relationships between the author's "cloze procedure" 
and the entropy or "uncertainty" measure of modern information 
theory were explored in an experiment based on the attempts of 
subjects to replace words that had been mechanically deleted 
from meaningful prose material. Certain aspects of the appli- 
cation, nature, and methodology of the cloze method also were 
investigated. 



Principles^ Concepts, or Procedures t Two sample passages, 
each containing 175 experimental words in sequence, were taken 
from each of two essays, X and Y. Previous pilot studies had 
indicated that X was significantly "easier" to comprehend than 
Y, as gauged by the larger proportion of missing X words cor- 
rectly replaced. 

Each passage was mutilated by counting out every fifth 
word, or 35 words altogether. The operation was repeated four 
times, beginning with different words, to yield five deletion 
versions that together took out all 175 words. Each version 
of each passage was reproduced on a separate page with a stan- 
dard-size blank in place of each missing word. A test assembly 
included one version of all four passages and contained 140 
(4 X 35) blanks. The five deletion versions and the alterna- 
tion of the order in which essays were represented produced ten 
kinds of assemblies, which were randomly distributed among 
about 300 freshman rhetoric students. 

Assemblies returned by 287 subjects were considered suffi- 
ciently filled in for the first stage of analysis i those that 
exhibited a whole passage with all blanks left unfilled were 
discarded. 

A subject's guess on any particular blank was scored as 
right only if it "closed the gap" in the word sequence by pro- 
posing the same word as the original one deleted. Any sub- 
ject's cloze score was simply the total of his correct guesses. 
The sum of its subjects' scores was the cloze score of any set 
of material. 



Initial analysis showed i (1) No significant difference 
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between X-then-Y and Y-then-X orders of presentation? (2) sig- 
nificantly higher scores for subjects exposed to either essay 
nearly two months before than for those not previously exposed 
to it J (3) significantly higher scores for X than Y, as pilot 
studies had predicted? (4) a significant overall difference 
among deletion versions for each essay. 

The subject total was reduced to 250 - 50 in each dele- 
tion-version group - by discarding assemblies with the most 
blanks unfilled. Then, ir addition to scoring subjects and 
materials, cloze scores were allocated to individual blanks 1 
that is, each of the 175 words was assigned the proportion of 
subjects (out of 50) that correctly guessed its identity from 
context. 



Conclusions: Subsequent analysis indicated: (1) a tendency 
for the accumulated percentage scores for each passage's five 
different deletion versions to converge as more successive 
words were taken into account? (2) a tendency for the mean cumu- 
latiye percentage score of all deletion versions to stabilize 
Within the first 20 to 4o words of each passage? (3) approxi- 
mately normal distribution of the cloze scores of subjects for 
each essay? W abnormal distribution of the cloze scores 
allocated to blanks (missing words), with more scores falling 
at the extremes than in the middle of the distribution for any 
passage . 

Exploration of the relationships between cloze and en- 
tropy measures was confined to the 250 subjects' performance 
on one passage from X essay. Each blank and its context of 
surrounding words constituted an individual "system, " the en- 
tropy of which was computed from the relative frequenciee with 
which each alternative was proposed by 50 subjects trying to 
guess the missing word. Computation used the basic formula 
for "average entropy": 

H a - ^ Piloggpj^ 

The correlation scattergram between cloze and uncertainty 
measures for each of the 175 words was abnormal. The rank- 
difference correlation between the distributions reached a 
highly significant value of -.87. 

Wien, for each word in series, the cloze percentage and 
Its paired relative uncertainty estimate were plotted in oppo- 
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j sition on a 100-point scale, about half the pairs exhibited a 

1 roughly complementary relationship. Exploration revealed 

that any cloze percentage is precisely complementary to the 
"maximum remaining relative uncertainty" of the system con- 
cerned. Such "maximum remaining" values were computed by re- 
moving the proportion of cloze responses from any set of 

! response alternatives, calculating the maximum absolute un- 

certainty of the possible alternatives remaining (as if all 
"wrong" alternatives), and then dividing by the maximum un- 
certainty for the whole system that included the cloze pro- 

^ portion. 

Many of the 175 word-response systems yielded actual 
remaining uncertainty values much smaller than their corre- 
sponding maximums. The difference between the observed and 
' maximum \alues was assumed to be that part of any system's 

total response performance not explained by organization 
toward production of the "correct" response, or by mere dis- 
organization (uncertainty), or even by both together. The 
difference appeared to involve an active influence that mis - 
directed, that tended to make subj ^cts agree on a "wrong" 
response, and this difference was postulated to be an "index 
of misdirection." The following formula was proposed to ex- 
press total performance with regard to any blank's system t 

Cloze ^ + Rem.Rel.H + Misdirection « 1.00 

All three sorts of measures were computed for each word 
in series, and analysis showed all three distributions to be 
normal. The rank correlation coefficient of the cloze and 
remaining relative uncertainty distributions was -.83, 

Various ways in which cloze procedure could be applied 
to communication problems, at various places in the process 
that links encoder and decoder, were illustrated and dis- 
cussed. J- 
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^Disserta tion Abstracts (Ann Arbor, Michigan t Univer- 
sity Microfilms, 1955 )t Vol. 15, No. 3t PP. ^65-465. (Pub- 
lication No. 10,55^. 127 pages). 



CHAPTER III 



THE CLOZE PROCEDURE AS A MEASURE 
OP COMPREHENSION 

The relationship of numerous aspects of comprehen- 
sion to the cloze procedure has been variously examined. 
1 

Bormuth assessed the factor validity of cloze 
tests as measures of reading comprehension, while Cranney 
compared two types of cloze reading tests for validity and 
reliability. 

Numerous studies have examined the cloze procedure 
as a technique for measuring reading comprehension. 
Jenkinson, as reported by Rankin, obtained correlations 
with cloze scores of .78 and .73 with the vocabulary and 
comprehension sections of the Cooperative Reading Test . 
Using the same test, Fletcher obtained correlations of 

•Bormuth, "Factor Validity of Cloze Tests as Mea- 

fUl^l °f ^®^'^^?I^S?"'P^!5®"f^0" Ability,- Reading Research 
Quarterly, k (I969), 358-365. 

2Adelbert Garr Cranney, Jr., "A Comparison of a 
Free-Response and Multiple-Choice Cloze Reading Test" (un- 

dissertation. University of Minnesota, 

i960 J • ^ 

,,4.*,.^ Procedure - Its Validity and 

Utility," p. 138. 

4, 

Junior Eugene Fletcher, "A Study of the Relation- 
ships Between Ability to Use Context as an Aid in Reading 
and Other Verbal Abilities" (unpublished Ph.D. disserta- 
tion. University of Washington, 1959) . 
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.63 and .55 respectively. 

Using the Dj agnostic Reading Test . Rankin^ found 

correlations of .68 and .60 between vocabulary and compre- 

2 

henc^on, and cloze scores. Ruddell obtained correlations 
ranging from .61 to .74 between cloze scores and the Stan - 
ford Achievement Test . Paragraph Meaning sub-test. 

3 

In her study, Gallant found correlations ranging 
from .65 to .81 with the Paragraph Reading section of the 
Metropolitan Achievement Test . Primary Batteries I and II 
and Elementary Reading Test. 

If 

Using every- tenth-word deletions, Schneyer found 
correlations of .7^ with vocabulary and .68 with comprehen- 
sion when the Gates Reading Survey was used. When noun- 
verb deletions were made, the correlations were .63 and 
•60 respectively. 

^Rankin. "An Evaluation of the Cloze Procedure as a 
Technique for Measuring Reading Comprehension" (unpublished 
Ph.D. dissertation. University of Michigan, 1958). 

"Robert Byron Ruddell, "An Investigation of the 
Effect of the Similarity of Oral and Written Patterns of 
Language Structure on Reading Comprehension" (unpublished 
Ed.D. dissertation, Indiana University, I963). 

^Gallant, "An Investigation of the Use of Cloze 
Tests as a Measure of Readability of Materials for the Pri- 
mary Grades." 

J. Wesley Schneyer, "Use of the Cloze Procedure 
for Improving Reading Comprehension," The Reading Teacher. 
19 (1965), 174-179. 
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As a measure of specific comprehension, cloze 
scores have been correlated with scores from comprehension 
tests based on the same material. Taylor^ found correla- 
tions ranging from .51 to .92, while Jenkinson, as reported 

2 3 
by Rankin, found a single correlation of .82. Bormuth 

found a single correlation of .93. 

The cloze procedure as a technique for measuring 
reading comprehension in specific situations has been the 
subject of much investigation. 

The effects on comprehension tests of various lexi- 
cal deletions were studied by Bradley. 

Swalm investigated the effects on reading compre- 

^Taylor, "Recent Developments in the Use of •Cloze 
Procedure I Wilson L. Taylor, "Cloze Readability Scores 
as Indices of Individual Differences in Comprehension and 
Aptitude," Journal of Applied Psvcholo^ . 1*1 (1957), 19- 
26 • 

2 

,t^.,.^ ^"^^^ Procedure - Its Validity and 

Utility," p. 138. 

3 

^Bormuth, "Cloze Tests as Measures of Readability 
and Comprehension Ability (unpublished Ed.D. dissertation, 
Indiana University, 1962). 

^ '*Michael Bradley, "Effects on Reading Tests of 
Deletions of Selected Grammatical Categories" (paper pre- 
sented at the National Reading Conference, Atlanta, 
Georgia, December 4-6, I969. 

^James E. Swalm, "Comparison of Oral Reading, Si- 
lent Reading, and Listening Comprehension Assessed by 
Cloze" (unpublished Ed.D. dissertation, Rutgers University, 
The State University of New Je-?sey, 1971). 
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hension, as measured by the cloze procedure, of the oral 

reading, silent reading, and listening of second, third, and 

fourth grade students, while Daugherty^ measured the reading 

comprehension of fourth grade students. 
2 

Sikes utilized the cloze procedure to assess fifth 
and sixth grade children's comprehension of original and 
published materials. 

The cloze procedure as a measure of the reading com- 
prehension of selected Mexican- American and Anglo-American 
elementary school children was analyzed by Crawford."^ 

Geyer utilized the cloze procedure as a predictor 
of the ability of junior high school students to comprehend 
social studies materials. 

The reading performance of selected students on 

•'•Joan Daugherty, "The Effect of the Cloze Procedure 
and Interspersed Questions as an Aid to Reading Comprehen- 
sion (unpublished Ph.D. dissertation, the University of 
AKron, 19/1 J • 

2 

Helen Cruse Sikes, "A Comparative Study of Cloze 
Procedure Scores on Original and Published Materials" (un- 
published Ed.D. dissertation. University of Southern 
Mississippi, 1971). 

- « * x^^^S ^!f^ Crawford, "The Cloze Procedure as a Mea- 
sure of the Reading Comprehension of Elementary Level Mexi- 
can-American and Anglo-American Children" (unpublished 
Toon^ <*issertation. University of California, Los Angeles, 
If 

^4^4. ^^^^ Geyer, "The Cloze Procedure as a Pre- 

dlctor of Comprehension in Secondary Social Studies Mate- 

, i iiiSSV^^^^^®'^ dissertation. University of Mary- 

land » 1970;. " 



7^ 



occupation information materials written at various reada- 
bility levels was determined by Knight. 
2 

Hater assessed the comprehensibility of mathemati- 
cal English in grades seven through ten. 

Greene and Rankin evaluated the cloze procedure 
as a technique for measuring the reading comprehension of 
college students. 

Fletcher^ utilized the cloze technique to measure 

the ability of college freshmen to use context, while 
6 

Peldman assessed the learning accrued from programmed and 

^David W. Knight, "The Reading Performance of Stu- 
dents With Ninth Grade Reading Achievement on Occupational 
Information Materials Written With Various Levels of Reada- 
bility- (unpublished Ph.D. dissertation, The Florida State 
University, 1966). 

2 

Sister Mary Ann Hater, "The Cloze Procedure as a 
Measure of the Reading Comprehensibility and Difficulty of 
Mathematical English" (unpublished Ph.D. dissertation. 
Purdue University, I969). 
3 

Frank Pierrepont Greene, "A Modified Cloze Proce- 
dure for Assessing Adult Reading Comprehension" (unpub- 
lished Ph.D. dissertation. The University of Michigan, 

19o*f ; . 

Rankin, "An Evaluation of the Cloze Procedure as 
a Technique for Measuring Reading Comprehension." 

^Fletcher, "A Study of the Relationships Between 
Ability to Use Context as an Aid in Reading and Other Ver- 
bal Abilities" (unpublished Ph.D. dissertation. University 
of Washington, 1959). 

^Margaret Eichbauer Feldman, "The Effects of learn- 
ing by Programed and Text Format at Three Levels of Diffi- 
culty" (unpublished Ph.D. dissertation. Cornel University, 
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text presentations of an introductory college psychology 
program • 

Guthrie^ studied the effect of delayed, immediate, 

and omitted cloze testing on the comprehension of prose sen- 

2 

tences by college students, and Sawyer and Braam investi- 
gated the effect of instruction in speed of comprehension 
upon reading comprehension developed from cloze exercises. 

The relationships between cloze scores and selected 
variables, such as intelligence, have been studied by Hafner, 
Gwaltney, and Robinson » Kohleri Lismani Taylor i and Weaver 
etal. 



John T, Guthrie, Motivational Effects of Feedback 
in Reading (Baltimore, Maryland « Center for~the~Study of 
Social Organization of Schools, Johns Hopkins University, 
1971). 

2 

Rita Sawyer and Leonard S. Braam, "An Experiment 
Combining Cloze Procedure With Speed of Comprehension In- 
struction," Proceedings of the College Reading Association , 
ed. by Clay A. Ketcham (Syracuse, New Yorki College Read- 
ing Association, 1964-, pp. 27-33. 

Lawrence E. Hafner, Wayne Gwaltney, and Richard 
Robinson, "Reading in Bookkeeping « Predictions and Per- 
formance,- Journal of Reading . lU (1971), 537-5^6 1 Emmett 
Theodore Kohler, "An Investigation of Cloze Scores in Terms 
of Selected Cognitive Variables" (unpublished Ed.D. disser- 
tation. The Florida State University, 1966)1 Linda C. Lisman, 
"Vowel Deletion and Cloze Tests Compared With a Reading 
Ability Test" (unpublished Master's thesis, Rutgers, The 
State University of New Jersey, 1971) » Wilson L. Taylor, 
Cloze Readability Scores as Indices of Individual Differ- 
ences in Comprehension and Aptitude," Journal of Applied 
Psychology, kl (1957), 19-261 and Wendell Weaver, Albert J. 
Kingston, A. C. Bickley, and William P. White "Information- 
Plow Difficulty in Relation to Reading Comprehension," 
Journal of Reading Behavior . 1 (I969), 4l-if9, 
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Comparable cloze and multiple-choice scores have 

been investigated by Bormuthj Mosberg, Potter, and Cornell} 

1 

and Rankin and Culhane. 

The concept of information gain has been studied by 

2 

means of the cloze procedure. Carver examined the exact 
scoring of cloze replacements as measures of information 
gained from reading. 

Coleman and Miller and Rankin and Dale studied 
information gain by using the cloze procedure with college 
students. 

Information gain when individualized and tradition- 



■"•Bormuth, "Comparable Cloze and Multiple-Choice 
Comprehension Test Scores," Journal of Reading. 10 (I967), 
291-299J LudwitT Mosberg, Thomas C. Potter, and Robert K. 
Cornell, The Relation Between Cloze and Multiple-Choice 
Test Scores as a Function of Relative Paragraph Difficulty 
and Grade Level (Inglewood. California t Southwest Regional 
Laboratory for Educational Research and Development, 1968)1 
and Earl P. Rankin and Joseph W. Culhane, "Comparable 
Cloze and Multiple-Choice Comprehension Test Scores," Jour - 
nal of Reading . I3 (1969), 193-198. 

2 

Ronald P. Carver, "What Is Reading Comprehension 
and How Should It Be Measured?" (paper presented at the 
National Reading Conference, Atlanta, Georgia, Dei ember 4-6, 
1969. 

3 

^E. B. Coleman and G. R. Miller, "A Measure of In- 
formation Gained During Prose Learning," Reading Research 
Quarterly . 3 (I968), 369-386. 

^arl P. Rankin and Lothar H. Dale, "Cloze Residual 
Gain - A Technique for Measuring Learning Through Reading," 
The Psychology of Reading Behavior , ed. by G. B. Schick 
and M. M. May, Eighteenth Yearbook of the National Reading 
Conference (Milwaukee, Wisconsin t National Reading Crnfer- 
ence, 1968), pp. 17-26. 
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al textbook approaches to science instruction were used 

1 

with fifth-grade students was investigated by Charles • 

The influences of several properties of the English 

2 

language on comprehension have been examined. Bormuth in«* 

vestigated the relationships between mean word depth and 

comprehension difficulty* as well as the influence of length 

of independent clauses on these two variables* 
3 

Coleman studied the effects of shortening sen- 
tences on comprehension of college students, while Darnell 
assessed the influences of sentence order on the comprehen- 
sion of college students ' 

Smith^ investigated the relationships between the 



Edward Charles, ••An Imestigation of the Use of 
Cloze Tests to Compare Gain Scores of Students in Science 
Who Have Used Individualized Science Materials and Those 
Who Have Used Traditional Textbook Materials" (unpublished 
Ed.D* dissertation, Lehigh University, 1970). 

^Bormuth, •*Mean Word Depth as a Pred5otor of Compre- 
hension Difficulty," California Journal of Educational Re - 
searchj 15 (196^), 226-231; John R. Bormuth, "New Measures 
of Grammatical Complexity," The Psycholinguistic Nature of 
the Reading Process , ed. by Kenneth S. Goodman (Detroit: 
Wayne State University Press, 1968)^ pp. 239-253. 

^E. B. Colenan, "Improving Comprehensibility by 
Shortening Sentences," Journal of Applied Psychology t 46 
(1962), 131-13^. 

^Donald K. Darnell, "The Relation Between Sentence 
Order and Comprehension," Speech Monographs > 30 (I963), 
97-100. 

^William Lewis Smith, "The Effect of Syntax on 
Reading" (unpublished Ph.D. dissertation. The Florida State 
University, 1969)# 
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maturity of syntactic structures and reading comprehension 
at selected grade levels, while the effect of the simi- 
larity of oral and written patterns of language structure 
on reading comprehension was studied by Ruddell.^ 

The effect of interest on reading comprehension 

was measured, in part, by the cloze procedure in a study 

2 

undertaken by Henry. 

3 

Rankin and Hess assessed internal reading flex^- 
bility, and Bloomer and Heitzman examined the effects of 
cloze pre-testing on reading comprehension. 



Ruddell, "An Investigation of the Effect of the 
Similarity of Oral and Written Patterns of Language Struc- 
ture on Reading Comprehension." 

^Peggy Elaine Henry, "The Effect of Interest on 
Reading Comprehension as Measured by Cloze and Multiple 
Choice Tests" (unpublished Ph.D. dissertation. The Univer- 
sity of Iowa, 1969). 

^arl P. Rankin and Allen K. Hess, "The Measure- 
ment of Internal (Intra-Article) Reading Flexibility" 
(paper presented at the National Reading Conference. Atlan- 
ta, Georgia, December ^-6, I969). 

Richard H. Bloomer and Andrew J. Heitzman, "Pre- 
testing and the Efficiency of Paragraph Reading," Journal 
of Reading. 8 (I965 , 219-223. ^ 
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BLOOMER, RICHARD H., AND HEITZMAN, ANDREW J. -PRE-TESTING AND 
THE EFFICIENCY OF PARAGRAPH READING." JOURNAL OF READI NG, 
8 (1965)9 219-223. 



Purpose : The author examined . . the relationship between 
information presented to the student in short selections and 
his comprehension of the material." (219) 



Principles! Conceptst or P r ocedures ? Materials were five of 
the most difficult passages in the HcCall-Crabbs Standard Test 
Lessons in Reading . 

Subjects were 146 students enrolled in six eighth grade 
clpsses. 

Treatment Group A was given the pre-test followed 
by the reading selection, followed in turn by a post- 
test which was identical to the pre-test. Treatment 
Group B was given the reading selection followed by the 
post-test* Treatment Group C was presented with the 
reading selection adapted for Cloze procedure by the 
omission of every tenth word, followed by the post-test. 
Treatment Group D was given the pre-test, followed by 
the Cloze procedure reading materials, followed by the 
post-test. (219) 



Conclusions : Among the conclusions were the following 1 

1. The response strength of the wrong response was de- 
creased when it was made in the pre-test. 

2. Pre-testing did not appear to improve compensation — 
attending more carefully to the unfamiliar material. 

3* • • the pre-test basically reduces the tension on 
the individual, reducing his motivation to learn." (223) 



BORMUTH, JOHN R. "MEAN WORD DEPTH AS A PREDICTOR OF COMPREHEN- 
SION DIFFICULTY." CALIFORNIA JOURNAL OF EDU CATIONAT. RE- 
SEARCH, 15 (196^), 226-231. 



Purpose t The purpose of the study was 

. . . to test a new method of measuring the grammati- 
cal complexity of sentences to see if it could be 
used to predict the difficulty children have in com- 
prehending written verbal materials. (226) 



Principles. Conce pts, or Procedures » The author tested three 
hypotheses. 

1. Over a set of passages as a whole there is a cor- 
relation between mean word depth and comprehension 
difficulty. 

2. There is a correlation between comprehension dif- 
ficulty and mean word depth when the subject matters 
of the passages are held constant and the Dale-Chall 
readabilities are systematically varied. Further, 
this correlation is higher than a similarly obtained 
correlation between comprehension difficulty and the 
Dale-Chall predicted difficulties. 

3. There is a correlation between mean word depth and 
comprehension difficulty when the Dale-Chall pre- 
dicted difficulties of the passages are held c. istant, 
and the subject matters of the passages are varied. 
(227-228) 

The nine passages used in this study were equally 
divided among three subject matter areas— literature, 
science, and social studies. One passage in each 
subject matter area had a Dale-Chall readability 
level of 4.5, 5.5, and 6.5. (228) 

For each passage a 50-item cloze test was constructed. 
The subjects were 150 children enrolled in Grades 5, and 
6 of a single school. The group's mean score on each cloze 
test was used as the measure of comprehension difficulty of 
the passages which were accordingly assigned ranks. "The 
depth of each word in each passage was determined. . . . 
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Ranks were assigned to the passages according to the relative 
sizes of the means of their word depths." (228) 



Conclusions: The first hypothesis was found to be significant 
at the .05 level. The Spearman rho correlation was .77. The 
second hypothesis yielded a Kendall W correlation of .33 be- 
cause of the perfect correlation between mean word depth and 
predicted difficulty. The third hypothesis yielded a Kendall 
W correlation of .78. Because this study demonstrated that 
mean word depth can predict differences in difficulty among 
passages differing on content, "... concept difficulty or 
idea density is, at least in part, no more than a tendency for 
authors to use different sentence structures when they write 
about different subject matters." (23O) 
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BORMUTHt JOHN "COMPARABLE CLOZE AND MULTIPLE- CHOICE COM- 
PREHENSION TEST SCORES." JOURNAL OF READING , 10, 291- 
299* 



Purpose t The author reports a study designed to build a 
"frame of reference by which the size of the cloze score can 
be interpreted" (291) when used as a measure of the comprehen- 
sion difficulties of a passage. 



Principles, Concepts » or Procedures : Nine passages of approxi- 
mately 275 words each were used and ranged in Dale-Chall reada- 
bility from 4.5 to 6.5* 

A 50*item cloze test and a 31-item multiple-choice 
test were made over each of /the/ nine passages* (293) 

The tests were administered under un^imed conditions 
to 100 pupils enrolled in Grades k and 5# All the 
cloze tests were administered before any of the mul- 
tiple-choice tests were given and before the subjects 
were permitted ':o read the passages from which the 
tests were made» Subjects were instructed to guess 
on all items where they did not know the correct 
answeri^* Approximately three days after a cloze test 
was administered, the multiple-choice test over the 
same passage was given. The subject first read the 
passage and then, without being allowed to refer to 
the passage, took the test over it# (293-29^) 

To determine if the multiple-choice scores were unusually 
inflated because of this prooddure, a second study was run# 
Two new samples, consistitig or 32 and 2? subjects from Grades 
4 and 5f were drawn r 

. . . each group took one of the composite multiple- 
choice testa after taking a cloze test over it and 
another without a cloze test preceding it. The test 
conditions and instructions were the same as those 
used in the first part of the study. No effort was 
made to match the groups, since the tests were 
matched for difficulty c (29^) 
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Conclusions t 

If the conventional readability standards are ac- 
cepted, a passage on which a student receives a 
cloze score of 38 percent is sufficiently under- 
standable to him to be used in his instruction* 
That is, he can correctly answer about 75 percent 
of the multiple-choice items that can be witten 
over that passage. On the other hand, if one de- 
mands as a criterion a multiple-choice score cor- 
rected for guessing, a cloze test score of ^3 per- 
cent is required to reach the same criterion level. 
(298) 

The second study demonstrated that the multiple-choice 
scores had not been unusually inflated because of the design 
of the first study. 



ERLC 
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BORMUTH, JOHN R. "NEW MEASURES OP GRAMMATICAL COMPLEXITY. 
THE PSYCHOLINGUISTIC NATURE OP THE READING PROC ESS . 
EDITED BY KENNETH S. GOODMAN. DETROIT : WAYNE STATE 
UNIVERSITY PRESS, I968, 239-253. 



Purpose t The purpose was 

1. "... to investigate the sizes of the correlations 
l>etween comprehension difficulty and ..." (239) frequency, 
mean word depth, and length of independent clauses. 

2. to discover ". . .if relationships between compre- 
hension difficulty and measures of grammatical complexity 
change as a function of the reading ability of the subject." 



Principles. Conce pts, or Procedures » The procedures reported 
here are the same as reported in "Experimental Applications 
of Cloze Tests. "1 



Conclusions t 



!• There was a significant correlation between all 
if*^f measures of grammatical complexity and comprehension 
difficulxy. 

2. Measures of mean word depth and length of independent 
Clauses did not appear dependent on reading ability. However, 
independent clause frequency was slightly significant as read- 
ing achievements increased. 



See page 8 of thia thesis. 
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BORMUTH, JOHN R. -FACTOR VALIDITY OP CLOZE TESTS AS MEASURES 
OP READING COMPREHENSION ABILITY." READING RESEARCH 
QUARTERLY . 4 (1969), 358-365. " 



Purpose! The author reports a study designed to examine the 
factor validity of cloze tests as measures of comprehension. 



Principles. Conce pts; or Procedures i Nine passages of 250 
words were chosen from various subject areas and ranged in 
Dale-Chall readability from 4.5 to 6.5. A fifty-item cloze 
test which utilized every-fifth-word deletions was constructed. 
Seven multiple-choice tests designed to measure vocabulary, 
factsi sequences, relationships, main ideas, inferences, and 
author's purpose were written and validated by judges. 

Subjects were 150 fourth, fifth, and sixth grade stu- 
dents who were administered the cloze tests first. The sub- 
jects were later permitted to read the passage and .then com- 
pleted the multiple-choice tests. Only exact replacements 
were scored correct. 



Cpnclusions 1 The correlations among cloze tests were high, as 
were most among all tests in the correlation matrix. 

It appears, . . • ; that cloze tests made by deleting 
every fifth word measure skills closely related or 
identical to those measured by conventional multiple- 
choice comprehension tests. Little or no evidence 
was found to suggest that the two types of tests might 
measure different skills. (365) 
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BRADLEY, MICHAEL. "EFFECTS ON READING TESTS OF DELETIONS OF 

SELECTED GRAMMATICAL CATEGORIES." PAPER PRESENTED AT THE 
NATIONAL READING CONFERENCE, ATLANTA, GEORGIA, DECEMBER 
1969. 



Purpose : An investigation was made of the effects of the re- 
moval of certain grammatical categories from standardized 
reading comprehension test paragraphs on the reading compre- 
hension of 180 third, fourth, and fifth graders enrolled in a 
rural Georgia school system. 



Principles, Concepts, or Procedures : Each grade level con- 
tained a high and low reading ability group, based on stan- 
dardized reading test scores. The materials used were para- 
graphs rnd the accompanying multiple-choice items from 
various standardized reading tests appropriate for these 
grade levels. The paragraphs were altered by deletion of the 
following grammatical elements: (1) all nouns, (2) all ad- 
jectives, (3) all verbs, W all function words, (5) all words, 
and (6) no words. 



Conclusions: The deletion of nouns had a significant effect 
at all three grade levels, but the deletion of adjectives had 
a significant effect only for fifth grade. It was also found 
that the subjects could answer the multiple-choice items with- 
out the aid of the accompanying reading paragraph at a level 
greater than cl.ance. Therefore, it was concluded that the read 
ing comprehension test was measuring other variables such as 
past learning and word association in addition to ability to 
take cues directly from the reading paragraph. Tables and re- 
ferences are included. ^ 



•" •Research in Education (Washington, D.C.t United States 
Government Printing Office, 1970), Vol. 5, No. 8, p. 88. 
(ED 038 242, 12 pages). 
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CARVER, RONALD P. "WHAT IS READING COMPREHENSION AND HOW 

SHOULD IT BE MEASURED?" PAPER PRESENTED AT THE NATIONAL 
READING CONFERENCE, ATLANTA, GEORGIA, DECEMBER ^^-6, I969. 



Purpose t Pour conceptually different variables in reading: 
(1) knowledge gained (new information), (2) amount comprehended 
(degree of understanding), (3) reading aptitude (differences 
between individuals), and (4) reading improvement (within in- 
dividual changes as a result of treatment) are discussed. 



Principl es. Concepts, or Procedures » Existing measures of 
reading comprehension are evaluated in terms of their potential 
for measuring these variables. It was concluded that most com- 
mercially available reading comprehension tests and the exact 
scoring cloze technique were inadequate measures or ir. '.icants 
of knowledge gained, amount comprehended, or reading improve- 
ment and should be regarded and used as measures of reading 
aptitude only. The Tinker Speed of Reading Test was recom- 
m-9nded as a measure of reading improvement and reading aptitude. 



Conclusions J The Carver-Darbv Chunked Reading Test which was 
designed and developed to measure the changes that take place 
S3 a result of reading was described and recommended as a 
standardized indicant of knowledge gained, amount comprehended, 
reading aptitude, and reading irapro* t ^.ent . Tables and refer- 
ences are included.! 



•^ Research in Education (Washington, D.C.j United States 
Government Printing Office, 1970), Vol. 5, No. 8, p. 88. 
(ED 038 2^3. 15 pages). - 
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CHARLES, EDWARD. "AN INVESTIGATION OP THE USE OF CLOZE TESTS 
TO COMPARE GAIN SCORES OF STUDENTS IN SCIENCE WHO HAVE 
USED INDIVIDUALIZED SCIENCE MATERIALS AND THOSE WHO HAVE 
USED TRADITIONAL TEXTBOOK MATERIALS." UNPUBLISHED ED.D. 
DISSERTATION, LEHIGH UNIVERSITY, I970. 



Purposes t The main purpose of this study was to determine if 
cloze tests are sensitive to gain measurement when an individ- 
ualized approach and a traditional textbook approach to science 
instruction are used. 

A secondary purpose of this study was to determine what 
relationships exist among the scores made by fifth grade chil- 
dren in both the experimental and control groups on standard- 
ized tests of reading and science ability and gain scores as 
measured by cloze test procedures. 



Principles. Concepts« or Procedures » A sample of three hundred 
children, one hundred fifty girls and one hundred fifty boys, 
was randomly selected from a population of five hundred and 
twenty fifth grade students in Centennial School District, War- 
minster, Pennsylvania. 

The following tests were administered: The Sequential 
Tests of Educational Progress. Reading. Level ^B and Science. 
Level 4B . were used to provide measures of rftading and science 
achievement. The investigator constructed cloze tests from 
inaividualized science activities and science textbooks. 

The instructional program covered three weeks which in- 
cluded one hundred sixty minutes of science instruction per 
week for both groups. Control group teachers taught tradi- 
tionally using a basal science textbook. Experimental group 
teachers used individualized science activities developed by 
a Bethlehem Area School District ESEA Title III program. 
Keys for Interdisciplinary Tutorial Study . 

The differences between gain scores made by pupils taught 
by the individualized method and those made by pupils taught 
by the traditional method were determined by a two factor 
analysis of variance. The relationships among general reading 
ability, science ability and gain scores on cloze tests were 
determined by the Pearson Product Moment coefficient of cor- 
relation. 



89 



Conclusions ; Analysis of the data showed the following: 

1. The gain scores of the experimental group were sig- 
nificantly higher than the gain scores of the control group on 
the cloze tests constructed from individualized science ma- 
terials with P. < ,001. 

1 vi^u "^^f ^^^^ scores of the control group were significant- 
ly higher than the gain scores of the experimental group on 
?!v,°J°^5 Hf^^ constructed from the science textbook materials 

3. Gain scores made by girls in both the experimental 
and control groups were significantly higher than gain scores 
made by boys in both groups on the cloze tests constructed from 
individualized science materials with P. < .01. 

^. There were no significant differences in the gain 
scores made by girls and boys in the experimental and control 
goups on the cloze tests constructed from science textbook 
materials with P. > ,05. 

5. With the experiip.i^ntal group, the highest relationships 
were found between the post-cloze test constructed from in- 
dividualized science materials and STEP Reading. The relation- 
ships between gain scores and all other variables were at best 
only moderately high. 

6, With the control group, the highest relationships 
were found among the pre -cloze test constructed from science 
textbook materials, STEP Reading, and the post-cloze test con- 
structed from individualized science materials. The relation- 
ships between gain scores and all other variables were at best 
only moderately high. 

The following conclusions were drawn on the basis of the 
analysis of the data. 

1. Cloze test instruments are sensitive to gain measure- 
ment • 

2, The 'individualized approach tj science instruction 
is not superior to the traditional science textbook approach 
in terms of cloze test gain scores after a three week period. 

*i*xv^' f^^J^ ^^^^ S^^^^ scored significantly higher than 
fifth grade boys on the cloze test constructed from individ- 
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ualized science materials probably because of superior read- 
ing ability. 

4, Fifth grade boysJ will do as well fifth graie 
girls in science provided the materials they are expected to 
read are suitable for them in terms of their level of reading 
achievement. 

5. Cloze test results are valid measures of reading com- 
prehension ability. 



Dissertation Abstracts International At The Humanities 
and Socia l Sciences (Ann Arbor. Michigani University Micro- 
films, 1971). Vol. 31. No. 10, p. 5026-A. (Oi-der No. 71- 
10,501, 89 pages). 
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COLEMAN, E. B. ••IMPROVING COMPREHENSIBILITY BY SHORTENING SEN- 
TENCES.- JOURNAL OF APPLIED PSYCHOLOGY . k6 (1962), 131-13it. 



Purpose I The effect of shortening sentences- on compreh^nsibil- 
ity was investigated. 



PrinciT)les» Concepts* or Procedures ; Three ten-sentence pas- 
sages were chosen from The Human Species by Geldard for re- 
writing into two versions containing six and fifteen sentences. 

Subjects were ninety college undergraduates who were 
divided into five groups. Since every-f ifth-word deletions 
were used, every word became a test item. Subjects were given 
fifty seconds to read each passage before completing it. Only 
exact replacements were scored correct. 



Conclusions t The shorter sentences were more comprehensible 
than the longer ones, but the magnitude of improvement was 
small. Pour hypotheses are suggested by the author for fur- 
ther study. 
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COLEMAN, E. B., AND MILLER, G. R. "A MEASURE OP INFORMATION 
GAINED DURING PROSE LEARNING." READING RESEARCH QU AR- 
TERLY . 3 (1968), 369-386. ' "~" 



Purpose t The authors describe two experiments designed to 
measure the degree to which a passage transmits new informa- 
tion. 



Experiment I 

Principles, Concepts, or Procedures ! Twenty college under- 
graduates were matched" with the subjects who had been admin- 
istered five forms of a cloze test in a previous study. 
Since the subjects in the previous study had not been*^ allowed 
to read the material before taking the cloze test, the sub- 
jects in this study were allowed to read the material before 
testing in order to compare the two scores to determine the 
amount of information gain. 

Materials and procedures were identical in both studies, 
except that in the second each subject was administered only 
18 instead of 36 passages. Sixty seconds were allowed for 
study and six minutes for completion of each passage. 



Conclusions : Because of the high correlation of .93 between 
the two scores, it appears that the cloze score before reading 
ir measuring essentially the same information as the cloze 
score after reading. 



Experiment II 

Principl es, Concepts, or Procedures : The materials used were 
identical to those in Experiment I. Subjects were nine college 
undergraduates who were tested as a single group, . Jy means of 
transparencies and an overhead projector, the experimenter re- 
vealed one word at a time after the subjects had written their 
prediction. Because the procedure was repeated, the difference 
in correct words was assumed to be a measure of information 
gained. 
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Conclusions t The mean gain per hundred words was 38.93, and 
the "before" and "after" correlation was .57. This procedure 
appears to be an accurate measure of information gain. Pas- 
sages containing few abstract nouns, few verb-nominalizations, 
few kernels, and many short words transmitted maximum infor- 
mation gain. 
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CRANNEY, ADELBERT GARR, JR. "A COMPARISON OF A FREE-RESPONSE 
AND MULTIPLE-CHOICE CLOZE /READING TEST." UNPUBLISHED 
PH.D. DISSERTATION, UNIVERSITY OF MINNESOTA, 1968. 



Purposes ; The cloze procedure consists of the presentation of 
a reading passage with deleted words. The reader is required 
to supply the missing words from the remaining context. Th'.s 
procedure has recently been applied to the measurement . of read- 
ing comprehension. 

Traditional reading tests are difficult to construct and 
tend to divert the attention of the reader to comprehension 
questions rather than to the reading of the passage itself. 
Cloze tests in both respects seem to offer an improved method 
of measuring reading comprehension. 

The purpose of the study was to compare two types of 
cloze reading tests with respect to validity and reliability. 
A second purpose of the study was to investigate the effects 
on reliability and validity of eliminating ineffective items 
from the two cloze tests. 



Principles, Concepts, or Procedures ! Two, 300 item cloze tests 
were constructed. The first was an every 10th deletion, cloze 
test based on six college textbook passages. The second test 
was based on the same material but was multiple -choice in form. 
Distractors for the correct responses on this test were general' 
ly synonyms. On the basis of item analysis techniques, I65 in- 
effective items were eliuinated from each test providing a long 
and short form of each test. Two groups of 100 college sopho- 
mores were administered the long and short forms of one of 
these tests and also the C ooperative Reading Test . Item selec- 
tion was based on two other groups of ^00 students each. 

Comparisons among the several test forms were based on 
reliability coefficients and validity correlations of cloze 
scores with Cooperative Reading Test comprehension scores. 
Tests of significance employed the t, F, or z statistics and 
the .01 level of confidence. 

1. Reliability coefficients on all test forms ranged from 
.83 to .93 and validity coefficients with the Cooperative Read - 
ing Test comprehension scores ranged from .51 to .54. 

2* The comparison of the free-response and multiple- 
choice test forms resulted in no significant differences in 
reliability. One significant validity difference was found 
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the multiple-choice form. This form also contained 
about 30% more difficult items and was the better test in re- 
spect to the distribution and range of item correlations with 
total cloze test scores. 

3. The shortening of each long test significantly de- 
creased the reliabilities of each of the shorter forms but did 
not significantly change validity coefficients with the Coope ra- 
tive Reading Test comprehension scores. 

^. Comparison between the short forms of the two tests 
resulted in a significant validity difference in favor of the 
multiple-choice test form, but no significant differences be- 
tween the reliabilities of the two forms. 

Conclusions : 

1. It was concluded that all cloze test forms were valid 
v!^?on^f comprehension having about 26fo of common 

variance with the Cooperative Reading Tast . 

„ ^I- test forms were also considered reliable measures 
or reading comprehension for group comparisons but not ade- 
quate for individual comparisons. 

3. Item analysis and selection procedures used in this 
study do not improve validity coefficients of either test. 

rt4-fo!t:„+'^^vM^2-°^°^®.*®^^^ constructed in this study tested 
different abilities and are, therefore, not comparable. 1 



- . Dissertation Abstracts At Tho Wnn,o nities a nd Snr^^l 
§ci£n£|S (Ann Arbor. Michigan: University Microfilms, I968), 
Vol. 29. No. 3. p. 811-A. (Order No. 68-12,251, I69 pages). 
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CRAWFORD, ALAN NEAL. "THE CLOZE PROCEDURE AS A MEASURE OF THE 
READING COMPREIffiNSION OF ELEMENTARY LEVEL MEXICAN-AMERI- 
CAN AND ANGLO-AMERICAN CHILDREN." UNPUBLISHED ED.D. DIS- 
SERTATION. UNIVERSITY OF CALIFORNIA. LOS AUGELES. 1970. 



Purpose t The purpose of this study was to investigate the va- 
lidity, reliability, and appropriateness of cloze tests as a 
measure of the reading comprehension of third and sixth grade 
Mexican-American and Anglo-American children. 

The three hypotheses and two related questions involved 
four basic problems: (1) the correlations between cloze test 
scores and scores on standardized reading tests and oral read- 
ing tests for groups at each grade level t (2) the differences 
among cloze test scores for groups at each grade level; (3) 
the reliability coefficients of cloze test scores for groups 
at each grade level; and (^) the degree of correspondence be- 
tween instructional reading levels determined by cloze tests 
and by standardized reading tests, oral reading tests, and 
teacher judgment, for groups at each grade level. 



Principles. Concep ts, or Procedures : The randomly selected 
population of 180 subjects consisted of third and sixth grade 
Mexican-American and Anglo-American children whose dominant 
home language was English, and Mexican-American children whose 
dominant home language was Spanish. Each of the resulting 
groups, which were designated MAE. MAS. and AE at each grade 
level, consisted of 30 subjects. On the basis of standardized 
reading test scores, the subjects at each grade level were 
classified as more able or less able readers. 

. The reading subtests of the Stanford Achievement Test , 
primary II. Form Y. and a cloze test at the second grade 
level were administered to all third grade subjects. The 
reading subtests of the Comprehensive Tests of Basic Skills . 
x.evel 2, Form_S[, and a cloze test at the fourth grade level 
were adminiatsred to all sixth grade subjects. The Gllmore 
oral Reading Test. Form C. was administered to selected sub- 
jects in each group at both grade levels. Additional cloze 
tests at other grade levels from first to seventh were admin- 
istered to all subjects in order to determine their instruc- 
tional reading levels. 
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Conclusions t Correlations between scores on cloze tests and on 
standardized reading tests and oral reading tests were signifi- 
cant for MAE, MAS, and AE subjects at the third and sixth 
graci levels. Correlations were significant for groups classi- 
fied as Kiore able or less able except where low variability was 
produced by the restriction on the range of scores. A signifi- 
cant difference among cloze test scores of the MAE, MAS, and 
AE groups at the third grade level did not appear at the sixth 
grade level. The reliability coefficients of all groups except 
the sixth grade MAE group were above .70. Reliability coeffi- 
cients for groups classified as more able and less able and 
for the sixth grade MAE group were affected by low variability 
produced by the restriction on the range of scores; results 
were therefore inconclusive. Instructional reading levels de- 
termined by cloze tests corresponded closely with those deter- 
mined by the other measures. 

It was concluded thai cloze tests were a valid and re- 
liable means of testing reading comprehension and determining 
instructional reading level for these third and sixth grade 
Mexican-American and Anglo-American children. 1 



J -Pisaertation Abstrac ts International At Tht* H.m an<-h^n« 
??? Michigan: University Micro- 

99 pages)! ' ^' No. 71-6??, 
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DARNELL, DONALD K. "THE RELATION BETWEETI SFITENCE ORDER AND 
COMPREHENSION." SPEECH MONOGRAPHS . JO (I963), 97-100. 



Purpose : This study investigated the relationship between 
the accuracy of predictions about the missing parts of a mes- 
sage and the order of the sentences within the message. 



Principles. Concepts, or Procedures ; The experimental message 
comprised fifteen sentences — a thesis, two major contentions, 
two subcontentions for each, and two assertions for each sub- 
contention. These sentences were systematically rearranged 
into six other orders. 

The seven resulting forms — ranging from "correct order" 
to "most mixed" — together with a control message were admin- 
istered to 1^0 college undergraduates. Each form was adminis- 
tered to twenty subjects. Time limits were imposed. The 
cloze deletion system is not described. 



Conclusions t While disorder did affect comprehension in this 
study, this finding is not generalizable. While showing that 
loss of clarity becomes greater as disorganization increases, 
the author cites several related areas requiring research. 
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DAUGHERTY, JOAN. "THE EFFECT OP THE CLOZE PROCEDURE AND IN- 
TERSPERSED QUESTIONS AS AN AID TO READING COMPREHENSION." 
UNPUBLISHED PH.D. DISSERTATION. THE UNIVERSITY OF AKRON. 
1971. 



Purpose ; The purpose of this study was: (1) to compare dif- 
ferent modes of presentation of reading material and evaluate 
their effects on reading comprehension as measured by retention 
on a multiple-choice testj (2) to ascertain if different pre- 
sentations of reading material produce different results in 
retention of Knowledge-, Comparehension-, and Ape li cation-type 
questions as defined in Bloom's Taxonomy of Educational Ob.iec - 
tives; (3) to substantiate previous research findings that the 
placement of questions does facilitate learning. 



Princip les, Concepts, or Procedures t The subjects were 197 
fourth grade pupils whose mean IQ score was within the normal 
range of intelligence (90-110) as measured by the California 
Test of Mental Maturity . The sample was limited to those 
schools located in geographical areas defined as white, middle- 
class socio-economic districts. 



The six treatment groups were as follows: 

1. Knowledge-type questions were interspersed in the 
reading passage after each paragraph. The subjects 
were required to answer each question mentally. 

2. Comprehension-t3rpe questions were interspersed in 
the reading passage after each paragraph. The sub- 
jects were required to answer each question mentally. 

3« The cloze procedure using a pattern of deletion of 
10 per cent of the noun determiners on each page of 
the reading passage required the subjects to replace 
the deletions* 

^. The cloze procedure using a pattern of deletion of 
every tenth word in the reading passage required the 
subjects to replace the deletions. 

^* J? i^^®levant reading passage was included to estab- 
lish a baseline of learning. 

6. The reading passage of the control group had neither 
deletions nor interspersed questions. 
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The reading material was in booklet form with the mul- 
tiple-choice test at the end of the booklets. The data col- 
lected was analyzed statistically by analysis of variance. 

Conclusions t The results indicated there was no significant 
difference between the mean score of the experimental treat- 
ment groups and the control group on the twenty-item multiple- 
choice test. On the subtests which consisted of eight Knowl- 
edge, seven Comprehension, and five Application questions, no 
significant difference existed. 

It was concluded that with the sample used in this 
study, neither interspersed questions nor word deletions 
aided comprehension. However, additional research should be 
conducted before definite decisions are made on which mode 



of presentation of reading material is most effective in'in- 

cimum level of comprehension is reached.! 



suring that the max: 



^ „ Dissertation Abstr acts International Ai The Humanities 
and Social Sciences (Ann Arbor. Mirhigflnt University Micro- 
films, 1971), Vol. 32, No. 2, p. 66^-A. (Order No. 71-20,275, 
82 pages). 
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PELDMAN, MARGARET EICHBAUER. "THE EFFECTS OF LEARNING BY 

PROGRAMED AND TEXT FORMAT AT THREE LEVELS OF DIFFICULTY." 
UNPUBLISHED PH.D. DISSERTATION, CORNELL UNIVERSITY, 
196^.1 



Purposes : The present study was designed to investigate two 
aspects of the stimulus characteristics of learning materials: 
first, programed or text formats and second, differing diffi- 
culty levels of the reading materials. One characteristic of 
the learner, namely his verbal ability, and the interactions 
among all three of these variables were also investigated. 



Principles, Concepts, or Procedure s t Three versions of a be- 
ginning psychology program were prepared by increasing the 
reading difficulty level from the original "standard - fairly 
difficult" level to one of "difficult" and another of "very 
difficult" reading level. Using these materials as a base, 
three text versions were prepared, one for each of the three 
difficulty levels, by filling in the blanks and organizing 
the materials into paragraphs. Half of a sample of l^k college 
students had been selected for high verbal, ability and half for 
low. Half of each of these groups took one or the other of the 
three difficulty levels of program and the other half took one 
of the three levels of text material. Tests of learning were 
by means of cloze tests which used material identical to that 
being learned, and transfer tests which asked students to 
transfer their learning to new problems. 



Conclusions : Using a cloze test measure of gains, no signifi- 
cant differences were found between learning by program or text. 
Using a transfer measure of learning, a significant difference 
was found in favor of text for low verbal ability subjects, 
with a trend in the same direction for high ability subjects. 
These findings lend support to the conclusion that format is 
not a critical determiner of learning with material similar to 
that being tested but that the larger "wholes" of the text 
appear to provide better transfer than the "parts," as repre- 
sented by the program items. It may be hypothesized that pro- 
gramed format destroys organizational patterns of the learner 
by the constant interruption by calls for response and may 



See also Margaret E. Peldman, "Learning by Programmed 
and Text Format at Three Levels of Difficulty," Appendix. 
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lead to premature clozure. 

No significant differences in learning were found at- 
tributable to the three difficulty levels of the learning ma- 
terials* although the materials were perceived subjectively 
by the subjects to conform to the expected difficulty levels. 
It may be that other values of the try-out procedure used to 
create programs, such as better organization and more reueti- 
tions, may be more critical for learning than the readability 
level. 

No significant differences were found between high and 
low verbal ability groups on gains as measured by the cloze 
test, but a significant difference was found in favor of the 
high ability group on the transfer test. 

A significant interaction was found between verbal abil- 
ity and difficulty level of the material on the cloze test 
measure of gains. Subjects made more gains when the material 
was at a level of challenge but still not too difficult. No 
other interactions were found to be significant. 

Perhaps the significant contribution of programed learn- 
ing will be an understanding of how to write textbooks which 
will communicate well and still offer the possibilities for 
organization by the student as provided by a text.l 



Dissertation Abstracts (Ann Arbor, Michigan: University 
Microfilms, 196^), Vol. 25, No. 3, p. 1738. (Order No. 6^- 
8105, 125 pages). 
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FLETCHER, JUNIOR EUGENE. "A STUDY OF THE RELATIONSHIPS BE- 
TWEEN ABILITY TO USE CONTEXT AS AN AID IN READING AND 
OTHER VERBAL ABILITIES." UNPUBLISHED PH.D. DISSERTA- 
TION, UNIVERSITY OF WASHINGTON, I959. 



Purpose : For the mature reader, . general context, total 
word form, and detailed word parts all function in word recog- 
nition. While the role of total word form and detailed word 
parts in the recognition of printed symbols had been rather 
thoroughly studied, the importance of the contribution made 
by context to the whole perceptual process of reading had not 
been as systematically investigated. It was the purpose of 
this study, therefore, to gather data of a quantitative nature 
which would give more specific information as to the impor- 
tance of the role played by ability to use context in word 
recognition. 



Principle s. Concepts, or Procedures ; To do this, the ability 
■to use context of 1?^ University of Washington freshmen was 
measured using an adaptation of Taylor's "cloze" procedure. 
A test was devised using three reading selections, each approxi 
mately 250 words in length, in which every fifth word was re- 
placed by a blank. The subjects were instructed to fill in 
the blanks with the words they thought belonged there on the 
basis of the surrounding verbal context. Scores were given 
on the basis of the number of blanks filled with words which 
matched those used by the author of the selection. 

Reading abilities were measured with the Cooperative 
English Test, Reading C omprehension and the Rate of Gompre - 
ftension Test, D vorak-Van Wagenen Examination of Silent Read - 
ing Ab3,lities. These provided scores for reading vocabulary, 
level of comprehension, and two rate of comprehension scores. 
In addition, the American Council on Education Examination 
of College Fresh men (ACE ) was ugad to moagiiyo gaway^oi ^^^rhnl 
ability. 



Conclusions: When test results were correlated, substantial 
relationships were disclosed between ability to use context 
as measured by the "cloze" procedure test and all of the tests 
of reading abilities and also the test of general verbal abil- 
iJ^'n.^^® tests designed to measure speed of comprehension, 

Dvorak-Van Wagenen Rate of Comprehension Test and the Co- 
operative English Test. Speed of Comprehension , showed practi- 
cally the same correlations with the "clsze" procedure test, 
•590 and .570, respectively, .hile their intercorrelation was 
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.5oO. The Cooperativ e -English Test . Level of Compre hensio n 
showed a correlation of .5^7 with the "cloze" procedure test 
while the Cooperative Eng lish Test . Vocabularv gave a correla- 
^nZ^ '^^^L. "^5® highest correlation, .718. was between the 
ACE, Linguisti c Section and the "Cloze" procedure test. 

A study was made of the characteristics of the "cloze" 
procedure test, particularly to determine its reliability. 
Reliabilities calculated using both the Kuder-Richardson 
Formula 20 and a split-half technique were the same, .87, 
which also indicated a highly homogeneous test. An examina- 
tion of the test items indicated a good spread of difficulty 
level and showed that almost all of them discriminated posi- 
tively between low and high scorers on the test. 

The substantial relationships between general ability to 
use context and reading abilities, as shown in this study, 
lent support to the conclusion that ability to use context as 
an aid in reiding is a significant underlying factor in the 
reading proficiency of the mature reader. 

It was recommended that the effects of variations in 
make-up, content, and method of administration of "cloze" 
procedure materials be further investigated? that studies be 
made at lower grade levels to gather information. about the 
growth of ability to use context? and that similar studies 
using cloze" materials and reading tests containing material 
closely comparable as to level of difficulty, type, and sub- 
ject matter content be carried out.^ 



^Dissertation Abstracts (Ann Arbor, Michigan i Univer- 
sity Microfilms, I960), Vol. 20, No. 7, pp. 2675-2676. (L. C. 
Card No. Mic 59-5^83, 104 pages). 
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GEYER, JAMES RUSH. "THE CLOZE PROCEDURE AS A PREDICTOR OF 
COMPREHENSION IN SECONDARY SOCIAL STUDIES MATERIAL." 
UNPUBLISHED ED.D. DISSERTATION, UNIVERSITY OF MARYLAND, 
1970.1 



Purpose* The major purpose of this study was to investigate 
the effectiveness of the cloze procedure as a predictor of 
students' abilities to comprehend social studies materials, 
A secondare investigation dealt with the effectiveness of 
utilizing social studies materials written on lower readabil- 
ity levels to improve comprehensibility. 



Principles* Concepts* or Procedures 1 The following hjrpotheses 
were investigated: 

A. Cloze Procedure 

1. Cloze test scores predict students' abilities to 
comprehend social studies materials "better than 
do standardized reading test scores. 

2. Cloze test scores predict students' abilities to 
comprehend social studies materials better than 
do I.Q. scores. 

3. Cloze test scores predict students' abilities to 
comprehend social studies materials better than 
do previous social studies grades. 

B, Rewritten Materials 

Students achieve higher scores on the criterion mea- 
sure, a multiple-choice test, when reading social 
studies materials written on a low readability level 
than when re?aing social studies materials written 
on a more difficult level. 

Instructional materials utilized in this study were two 
junior high school American history texts. Both texts con- 
tained identical topics and visual aidsj however, readability 
levels rated by the Dale-Chall readability formula were dif- 
ferent. 



See also James R. Geyer, "Cloze Procedure as a Predic- 
tor of Comprehension in Secondary Social Studies Materials," 
Appendix. 
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Thf data consisted of scores from the pre-reading cloze 
tests, an I.Q. test, previous social studies grades, a stan- 
dardized reading test, and the criterion measure, a multiple- 
choice test. The subjects were 201 eighth-grade students 
from a junior high school population. All subjects completed 
one of two cloze test forms. Then they read the chapter in 
the text from which the cloze test had been developed and com- 
pleted the multiple-choice test. Significant differences at 
the .01 level between two correlation coefficients involving 
a common variable were investigated in reference to the cloze 
hypotheses. An analysis of covariance was applied to ascertain 
the effectiveness of rewritten social studies materials on 
lower readability levels as a means of improving comprehensi- 
bility of that material. 



Conclusions : The following conclusions were drawn from the 
findings. < 

1. The research hypothesis that cloze test scores pre- 
dict students* abilities to comprehend social 
studies materials better than do standardized read- 
ing test scores was not supported by the data. 

2. The research hypothesis that cloze test scores pre- 
dict students* abilities to comprehend social 
studies materials better than do I.Q. scores was 
not supported by the data. 

3. The research hypothesis that cloze test scores pre- 
dict students* abilities to comprehend social 
scudies materials better than do previous social 
studies grades was not supported by the data. 

4. The research hypothesis that students achieve high- 
er scores on the criterion measure, a multiple- 
choice test, when reading social studies materials 
written on a low readability level than when read- 
ing social studies material written on a more diffi- 
cult level was not supported by the data. 

The following recommendation for practice is suggested 
by the data from the study » Care should be taken to ascertain 
that published materials which are rewritten on lower reada- 
bility levels are more readable for the intended student. The 
data of the study suggest that application of readability for- 
mulas may not predict the ability of students to comprehend 
the materials adequately. 

Several implications for research are suggested by the 
data. First, although the cloze procedure was not found to be 
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the host predictor of ability to comprehend specific instruc- 
tional material, it was correlated highly enough with the cri- 
terion measure to warrant further investigation. The rationale 
for the preceding statement lies in the significant differences 
at the .05 level for hypotheses two and three. Secondly, a 
further investigation of the effectiveness of combinations of 
independent variables as criteria for predicting academic 
success in content areas appears to be warranted. Such an 
investigation is especially relevant because of evidence that 
quantitative evaluation of instructional material may not give 
a true picture of readability. 

The theory which is the basis for most readability formu- 
las involves objective, quantitative assessment of passages. 
Implications for theory include continued investigation of 
certain qualitative factors. Assessment of such qualitative 
factors as concept load, abstractness, and organization, es- 
pecially through interaction involving the reader and instruc- 
tional material, is recommended.! 



f 

ERIC 



1 

Dissertation Abstrac ts International A» The Humanities 
and Social Sciences (Ann Arbor, Michigan: University Micro- 
filmsTT970yr7oir31» No. 5. p. 2002-A. (Order No. 70-22, 
5^9, 152 pages). 
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GREENE, PRANK PIERREPONT. "A MODIFIED CLOZE PROCEDURE FOR 

ASSESSING ADULT READING COMPREHENSION." UNPUBLISHED PH.D. 
DISSERTATION, THE UNIVERSITY OF MICHIGAN, 1964.1 

Purpose : This study reports 1) an investigation of the effect 
on concurrent validity of modifying the standard cloze proce- 
dure and 2) an attempt to demonstrate two components of reading 
comprehension as measured by the cloze technique. 

Principles. Concep ts, or Procedures ; The cloze procedure con- 
sists of deleting every nth word from a reading passage. The 
deleted words are replaced by numbered blanks, and the reader 
is asked to fill in the words missing from the passage. The 
percentage of words to be deleted is set and restrictions as 
to the class (es) of words eligible for deletion may be set. 
The deletion process is automatic: within the chosen deletion 
rate and eligible words, every nth word is removed. 

The standard procedure used was the automatic deletion of 
every 12th word with no word class restrictions. The modified 
cloze procedure restricted eligible words to nouns, verbs, ad- 
verbs, and adjectives (content words) and each potential dele- 
tion was evaluated for possible effectiveness. For each word 
deleted under the modified procedure, there was felt to be 
sufficient redundancy remaining in the Passage so that a su- 
perior reader could make positive identification of the missing 
word • 



^ All testing was completed in one regularly scheduled class 
period; The subjects (N = 128) were all regularly enrolled in 

fiSi ?''^''?''/^oL°^ !f^°^^f^':i^S"^ divided in the proportions, 

80% female/ 20?? male and 569? undergraduate/ 44^ graduate stu- 
dents. 



Conclusions : The following findings were reported: 1) No sig- 
nificant differences were found between the coefficients of the 
"^^^St^P procedures and two standardized reading tests. All 
coefficients were significant. ^ 

2) Two cloze tests constructed by the standard procedure 
but starting with different words did not differ in mean score 
or standard deviation. 



^See also Frank P. Greene, "Modification of the Cloze Pro- 
cedure and Changes in Reading Test Performances," Appendix. 
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3) Item discrimination indices (r) demonstrated that the 
modified cloze procedure produced items of higher "quality." 
Item difficulty indices (e) showed that the modified procedure 
eliminated items of* extreme difficulty or ease. 

4) The cloze scores were not significantly raised by 
reading the original passage prior to taking the cloze test as 
contrasted with taking the cloze test without prior reading. 

5) Reading rate was found to be correlated at a low, but 
significant level with the performances on the cloze tests. 

6) Multiple correlation coefficients of the cloze tests 
results with the power and context vocabulary tests, while sig- 
nificant, accounted for only about one third of the cloze test 
variance . 

It was concluded that 1) the modified cloze procedure does 
not improve the effectiveness of the standard cloze procedure 
as a measure of adult reading comprehension, and 2) the two vo- 
cabulary tests (power and context) do not, by themselves, 
account for the variance of the cloze measure of reading com- 
prehension.-^ 



„, IDissertation Abstracts (Ann Arbor, Michigan t University 
Microfilmi, 1965), Vol. 25, No. 10, p. 573^. (Order No. 65- 
5308, 130 pages). 
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GUTHRIE, JOHN "MOTIVATIONAL EFFECTS OF FEEDBACK IN READING 

BALTIMORE, MARYLAND; CENTER FOR THE STUDY OF SOCIAL OR- 
GANIZATION OF SCHOOLS, JOHNS HOPKINS UNIVERSITY, 1971- 



Purpose t The effects of feedback on motivation were investi- 
gated with a 3 X 3 factorial design* 



Principles* Concepts, or Procedures t Adult subjects (72 male 
college students) read prose sentences and completed cloze 
test items. Feedback on each item was either immediate, de- 
layed, or omitted. A cloze retention test over the sentences 
was given either immediately, delayed, or was omitted.^ To 
assess motivation, the subjects were given a continuation of 
the original passage which they read for as long as they wished. 
The time spent reading was recorded as a measure of persever- 
ance and motivation. 



Conclusions t The results indicated that (1) delayed feedback 
produced significantly more learning on the original task than 
did immediate feedback, (2) immediate feedback produced sig- 
nificantly more perseverance on the continuation passage than 
did delayed feedback, and (3) perseverance on the continuation 
passage was positively correlated (.4-6) with scores on a com- 
prehension test over the continuation passage. The results are 
explained in terms of differential affective responses ac- 
quired to the reading task under different feedback conditions. 
Tables, references, and appendixes are included. ^ 



^Research in Education (Washington, D.C.t United States 
Government Printing Office, 1971) t Vol. 6, No. 1, p. 75* 
(ED 042 590, 35 pages). 
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HAFNER, LAWRENCE E. { GWALTNEY, WAYNEt AND ROBINSON, RICHARD. 
"READING IN BOOKKEEPING: PREDICTIONS AND PERFORMANCE. 
JOURNAL OF READING . 1^ (1971) » 537-5^. 



Purpose t The study was undertaken to determine the relation- 
ships between intelligence, reading, and teachers' ratings of 
students' characteristics. 



Principles, Concepts* or Procedures ! Subjects were 45 male 
and female high school students enrolled in bookkeeping classes. 
Three cloze tests were administered to all subjects. One 
utilized every-fifth-word deletions in randomly selected pas- 
sages from one of students' texts. Another utilized every- 
fifth-noun or verb deletions in randomly selected passages of 
the same text. The third again used the same text but re- 
quired subjects to replace deleted punctuation marks. 

Teachers rated the subjects on the following variables: 
intelligence, achievement motivation, reading ability, and un- 
derstanding of bookkeeping content in the text. Results from 
previously administered intelligence and achievement tests 
were also used. 



Conclusions X Among the conclusions were that significant rela- 
tionships existed between reading-cloze and measures of intelli- 
gence and achievement. 



112 



HATER, SISTER MARY ANN. "THE CLOZE PROCEDURE AS A MEASURE OF 
THE READING COMPREHENSIBILITY AND DIFFICULTY OF MATHE- 
MATICAL ENGLISH." UNPUBLISHED PH.D. DISSERTATION, PURDUE 
UNIVERSITY, 1969. 



Purpose t The cloze procedure has been used by researchers as 
a measure of readability. Cloze tests are constructed by de- 
leting words or symbols from passages and replacing them with 
blanks. The subject attempts to complete the passages. His 
score for each passage is the number ,f responses which match 
the deleted material. 

Although the cloze procedure has been validated as a mea- 
sure of comprehensibility and difficulty for English passages, 
cloze tests cannot be used indiscriminately to measure these 
constructs without considering the content area of the passages. 

In this research, the cloze procedure was applied to math- 
ematical English. Because of the concentrated symbolism and 
other factors which differentiate mathematical English from or- 
dinary English, the cloze procedure was adapted to be used in 
this content area. In particular, the reliability and validity 
of the cloze procedure as a measure of the reading comprehensi- 
bility and difficulty of mathematical English passages were 
studied. Reliability was measured by the K-R formula 20 and 
by ranMngs of means. The validity of the cloze procedure as a 
measure of reading comprehensibility was assessed by correlating 
scores on cloze tests with scores on comprehension tests written 
over the same passages. The validity of the cloze procedure as 
a measure or raading difficulty was assessed by correlating the 
means on cloze tests with the means on comprehension tests writ- 
xen over the same passages. 



Principles, Concepts, or Proc^dnrP«« Five mathematical English 
passages, five comprehension tests on the passages, and twenty- 
five cloze tests, five for each passage, were the basic mate- 
rial administered to i,717 subjects of Grades 7 through 10, 

gpnclusionst Results of this study supported the hypothesis 
that cloze tests over mathematical English passages are highly 

^See also Mary Ann Hater and Robert B, Kane, "The Cloze 
Procedure as a Measure of the Reading Comprehensibility and 
Difficulty of Mathematical English," Appendix. 
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reliable measures for large or small groups, and across Grades 
ZJf«°i^2 ^?.°u each grade. Cloze tests over mathe- 

?n«r:2L«c?i-?^^^^^^^®!u^''®.y^^^*^ predictors of the reading 
comprehensibility of mathematical English passages for the 
grades tested. An average linear correlation of 0.69 (using 
a I transformation) was found to represent the relationship 
between cloze test and comprehension test scores. This cor- 
relation may underestimate the relationship between cloze 
tests and comprehension tests since a quadratic model accounts 
for more variance than a linear model. However, the addition- 
Si c^^finJ?® '"^^ ^® u° a^^i^'acts of guessing and subjects' 
distributions on comprehension tests. 

Double cross-validation techniques within the same popu- 
lation were used to arrive at these conclusions. Not only were 
the correlations between cloze tests and comprehension tests 
nigh, but correlations were also similar for the different 
samples tested over the same passages and for samples tested 
over different passages. Therefore, conclusions concerning the 
strengthened predictors of comprehensibility were 

r-nnVoS^+S! ^^^^ mathematical English passages were 

ranked the same by different samples from the same population 
and were related highly for samples from different grade 

ifl o Sill 5?^' ''^^ concluded that the ranking of cloze tests 
18 a reliable measure. 

+hio !!f!Sf number of mathematical English passages used in 
this study was only five, conclusions concerning thf validity 
Ci.^l°lLt measures of reading difficulty are tentative. 

mini Jor four"n/?^! J-"^^*^ ^^"^ comprehension test 
JfnC?«; 5 II passages. The difference in the 

fifth passage alone caused correlations to be 
^^^^l^i'. Consequently, there is enough evidence to 
suggest the probable conclusion that cloze tests are valid pre- 
dictors of reading difficulty for mathematical English passages." 



. ^ ^^ff?^;"^?"^^"" Abstracts Internati o nal A: The Humanities 
§?V Social S ciences (Ann Arbor. Michigan. Un iversity Micro- 
33i'"p*g sI ^' ^829-A. (Order No. 70-8900. 



Ilk 



HENRY, PEGGY ELAINE. "THE EFFECT OF INTEREST ON READING COM- 
PREHENSION AS MEASURED BY CLOZE AND MULTIPLE CHOICE 
TESTS." UNPUBLISHED PH.D. DISSERTATION, THE UNIVERSITY 
OF IOWA, 1969. 



Purpose t The central problem studied in this investigation wa 
how interest affected reading comprehension. There were two 
measures of reading comprehension and two separate designs em- 
ployed to study this question. 



Part I 

Principl es, Concepts, or Procedures ? Part I of the study in- 
cluded 80 matched pairs of boys and 82 matched pairs of girls 
who were tested in reading comprehension by means of tradi- 
tional multiple choice tests. First, each child took a pre- 
test over a selection he had not yet read. Seven days later 
he read the selection and took a post-test over the content 
contained in it. Two selections, comparable? in readability, 
weie involved in this design, one about a topic chat appealed 
to boys and one about a topic that appealed to girls. The 
two members of each pair read and took tests over different 
selections. 



Conclusions t Comparisons were made between boys and girls on 
the same selection and between groups of the same sex on dif- 
ferent selections. The differences between the mean scores 
of these four groups were tested simultaneously with analysis 
of covariance, then the adjusted means of the various groups, 
two at a time, were tested for significance with t-tests. 

The following differences between the adjusted mean 
scores were significant at the .05 level of confidence: 1. 
The mean score of the girls was higher than the mean score of 
the boys on the test over the selection that was appealing to 
the girls, 2. The mean score of the boys was higher than the 
mean score of the girls on the test over the selection that 
was appealing to the boys. 3. The mean score of the girls on 
the test over the selection that was appealing to the girls 
was higher than the mean score of the girls on the test over 
the selection that was appealing to the boys. 

It was concluded that reading comprehension as measured 
oy the multiple choice tests in this study appeared to be posi 
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tively and significantly affected by the readers* interest in 
the selection over which the tests were constructed. 

Part II 

Principles, Concepts, or Procedur es « Part II of the study wac 

M^^o^J^f+r^*" ^^"""^^ g^^^^^s ^ho took two se^s o? 

selections comparable in readability. 
+So5 f selections consisted of pairs, one about a topic 

that would appeal to boys and the other about a topic that 

^^^^^ set of cloze tests, 

S^^ indicated a preference for one of the selections 
in the set. One hundred thirty-six subjects took the first 
set of cloze tests and 149 took the second set. 

Conclusions t Comparisons were made between the two preference 
groups for each of the four cloze tests. That is! the subiects 
selection and the subjects prefe"lng the other 
selection were compared on the same selection. 

c.^nr.ot'^oi^+j;^ °^ coyariance with ITBS reading comprehension 
pn^^vL^fJ^^H statistical design used to 

^ ip«H^^^ o^^?-: This served to equate the preference groups 
on reading ability so that initial differences in readinl 
?hi i^Lrr reflected in the subjects* cloze test stores. 
The tests for each of the four preference groups indicated 
«5ln JJf ^ ''^^ no significant differences betSeei airtwo 
w¥fl Iro!^??* conclusion drawn was that for these sub- 

jectsp over these two sets of selections, preference for a 
selection did not appear to affect how it Jas comprehended 
when comprehension was measured by cloze tests. 1 



^Pfssert^tion Abstracts Internat i onal A« The Humanit ies 
g??J°°lQ7n^"v^ ,l^ Michigan. University Mcro! 

7J'4369'^l?i'pIge;)?'' ^' 3857-A.3858.A. (oJder No. 
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KNIGHT, DAVID W. "THE READING PERFORMANCE OF STUDENTS WITH 

NINTH GRADE READING ACHIEVEMENT ON OCCUPATIONAL INFORMA- 
TION MATERIALS WRITTEN WITH VARIOUS LEVELS OF READABILITY." 
UNPUBLISHED PH.D. DISSERTATION, THE FLORIDA STATE UNIVER- 
SITY, 1966. 



Purpose t The purpose of this study was to investigate the 
ability of students whose reading achievement on the Metropoli - 
tan Achievement Test is at the 9th grade level, to comprehend 
occupational information materials written at the 9th, 12th, 
and 15th grade levels as determined by the Flesch Readability 
Formula . 



Princip les, Concepts, or Procedures : The study was designed 
to make a comparison between 9th grade reading achievement and 
reading passages of occupational information written at three 
levels of readability. A treatment X subjects design was used. 
The treatments were one 50 item cloze test at each level of 
readability. The subjects were I50 students whose score on the 
reading section of the Florida State-Wide Ninth-Grade Testing 
Program was I .5 S.D. of the mean for all students included in 
the Florida based norms. 

The Flesch Readability Formula was used to analyze occu- 
pational information briefs randomly selected from the S.R.A. 
Occupational Information Kit. Each level of readability was 
represented by a 300 word passage. Cloze tests were made over 
each passage. A cloze test score for each paaf?age was derived 
oy averaging the percentage of words correctly restored to its 
cloze test forms. This passage cloze score became the basic 
cloze measure for the analyses. Three tests, one for each 
level of difficulty, yere bound into a booklet with a cover 
sheet of instructions. The tests within the booklet were placed 
in random order. Only when a subject wrote in the blank the 
exact word deleted, was his response counted correct. 



Conclusions 1 An analysis of variance with repeated measures 
and a multiple analysis t-test were used to analyze the data. 
Significant differences at the .05 level were indicated in the 
subjects performance on levels 9 and 15, also on levels 12 and 
15. No significant differences were found in the subjects 
performance on levels 9 and 12 at the .05 level. 

The rate of comprehension of .occupational information ma- 
terials decreased as the readability of these materials de- 
creased. 
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The Flesch Readability Formula ranked the reading pas- 
sages in the same order of rea-^sbility as that indicated by 
the performance of the subjects on the cloze tests. 

The occupational information materials rated at the 9th 
and 12th grade levels by the Flesch formula appear to be writ- 
ten at the instructional level {75fo to 9095 comprehension) for 
subjects with 9th grade reading achievement. 

Occupational information materials rated at the 15th 
grade level by the Flesch formula approached the frustrational 
level (less than 75% comprehension) for subjects with 9th grade 
reading achievement. 

None of the occupational information used in this study 
appears to be written at the independent level {90% comprehen- 
sion) for subjects with 9th grade reading achievement. 

The degree of comprehension of occupational information 
by 9th grade reading achievement is dp+.ermined by the reada- 
bility level at which these materials are written. 

The Flesch Readability Formula may be used to estimate 
the readability of occupational information if the obtained 
estimates are interpreted in broad limits or multiple grade 
level categories rather than as indicators of specific grade 
levels. 

Occupational information which is ratxid at the 9th grade 
level cannot be easily understood by students with 9th grade 
reading achievement . 1 



Dissertatio n Abstracts A» The Humanities and Social 
Sciences (Ann Arbor. Minhigam University Microfilms, 19^7 ), 
Vol. 27, No. 8, pp. 2if25-A-2^26-A. (Order No. 67-297, 71 
pages). 
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KOHLER, EMMETT THEOFORE. "AN INVESTIGATION OF CLOZE SCORES IN 
TERMS OF SELECTED COGNITIVE VARIABLES." UNPUBLISHED ED.D. 
DISSERTATION, THE FLORIDA STATE UNIVERSITY, 1966. 



Purpose > The major purpose of this investigation was to study 
the relationships between cloze scores and selected cognitive 
variables. The principal question asked was. What are the rela 
••■ionships between scores obtained on the selected factor-pure 
nitive ability tests and scores obtained on the cloze tests 
< !? Additional, but subordinate questions asked were 1. What 
aie the relationships between the various scores derived from 
the cloze tests? 2. What are the relationships between the 
cloze scores and a set of factorially more complex achievement 
and ability measures? 



PrincjpleSi Concepts, or Procedurss t The subjects for this 
study were 257 tenth-grade students from one Florida public 
high school. The data from these studonts were used for all 
the major analyses with the exception that only the data from 
200 of these were used for the analyses of the relationships 
between the scores obtained on the Florida State Wide Ninth - 
grade Te sting Program tests and those from the cloze tests. 

The 250 word cloze tests were constructed from eight ran- 
domly selected passages by use of an every-fifth-word deletion 
process. There were two tests from four subject matter areas » 
(1) Biology, (2) Chemistry, (3) American Government, (k) World 
History. Three scores were obtained for each test: (1) Total 
number of words correctly replaced, (2) number of Content words 
correctly replaced, (3) number of Connective words correctly 
replaced. 

A battery of eleven factor-pure tests described in the 
Manual fo r Kit of Reference Tests for Cognitive Factors and 
eight Florida Sta te Wide Ninth-grade Testing Program tests 
which included the School and College Ability Test , and tests 
from the Metropolitan Achievement Tests battery were used as 
independent variables. 

The major statistical techniques used were multiple 
linear regression analyses supplemented by canonical correla- 
tion analyses. The relationships between the various cloze 
scores were investigated through the use of factor analysis. 



Conclusions t Several conclusions were drawn." 

(1) The cloze tests appear to be relatively independent of 
the content covered by the tests and little additional informa- 
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tion was gained from the use of the Content and Connective word 
scoring schemes. 

'^^^^^ ''^f ! general factor present in the cloze scores 
which was believed to be factorially complex and highly related 
*o "the School and College Ability Test . Verbal score. 

(3) Although the Florida State Wide Ninth-grade T esting 
^£2S£^ battery generally did a better job of prediction~thtn 
did the factor-pure test battery, the analyses of the cloze 
tests in terms of these factor-pure tests did provide informa- 
tion as to the abilities required in the successful completion 
of the cloze task. The tests used to measure these abilities 
are presented below in order of their importance. 

(a) Wide Ran^9 Vocabulary. This ability was thought to 

i!u'^^2" °^ subject's knowledge of grammatical rules 
and breadth of vocabulary. 

(b) Logical Reasoning. This was believed to be a some- 
what formal reasoning ability which is related to the use of 
rather rigid sets of rules to solve problems. 

+ I?^ Inference. This measure of reasoning was believed 

!u formal, more flexible approach to the prob- 

lem of the cloze task. 

(d) Addition. This test was believed to represent a 
??®®^ ^ Since the time allowed for each cloze test was 
lixed, this ability to rapidly cover the test could provide the 
student with more exposure to the 'Jontextual clues found within 
tie cloze passage. 

(e) Hidden Patterns. This measure of Flexibility of 
Closure was thought to be important because there are times 
when given solutions are technically correct but must be cast 
aside in light of the contextual restraints imposed by the pas- 

abilities measured by the following tests appeared 
to be relatively less important in the successful completion of 
tne cloze task. 

Planning Air Maneuvers Picture-Number 

Map Planning Cube Comparison , 

Object Syn thesis Figure Classification 

- - ^Diasertatlon Abstra cts At The Humanities and Snri al 

Arbor, Michigan! University Microfilms, I966), 
Vol. 27. No. 1, pp. 114-A, 115-A. (Order No. 66-5454, 105 pages). 
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LISMAN, LINDA C. "VOWEL DELETION AND CLOZE TESTS COMPARED WITH 
A READING ABILITY TEST." UNPUBLISHED MASTER'S THESIS, 
RUTGERS, THE STATE UNIVERSITY OF NEW JERSEY, 1971. 



Purpose : The author does not state her purpose. 



Principles, Concepts, or Procedures » Fifty-seven seventh and 
60 eighth graders were divided into three reading ability 
groups. All were given the Wechsler Intelligence Scale for 
Children (WISC) prior to the study and the Gates-MacGinitie 
Reading Test — Survey E for grades 7 to 9 immediately after the 
study. A practice sample was given before the tests on pre- 
pared vowel deletion and cloze passages. 



Conclusions t Performance on both tests was correlated with 
each other, with scores of the reading test, and with the WISC 
scores. Correlation between vowel deletion and cloze scores- 
was found to be .^3 for the total group. Vowel deletion cor- 
related significantly with the reading test (spefed, .51j 
accuracy, .63» vocabulary, .57» and comprehension, .51), and 
with the IQ test (performance, .39; full scale, .45j and ver- 
bal, .37). The correlation was higher for eighth graders on 
speed, accuracy, and vocabulary, but higher for the seventh 
graders on comprehension. The cloze test correlated with the 
reading test as follows « speed, .29» accuracy, .41j vocabu- 
lary, .55 J and comprehension, .60. It correlated with the IQ 
test as follows J performance, .28» full scale, .46j verbal, 
.50. Generally, for all measures except verbal IQ and read- 
ing comprehension, the vowel deletion correlations were higher 
than or almost identical to the cloze correlations for the 
total population. Tables, a bibliography, and appendixes are 
included.-"- 



Research in Education (Washington, D.C.i United States 
Government Printing Office, 1971), Vol. 6, No. 12, p. 77. 
(ED 053 89^, paf^eK 
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MOSBERG, LUDWlGj POTTER, THOMAS C; AND CORNELL, ROBERT K. 
THE RELATION BETWEEN CLOZE AND MULTIPLE-CHOICE TEST 
SCORES AS A FUNCTION OF RELATIVE PARAGRAPH DIFFICULTY 
AND GRADE LEVEL . INGLEWOOD, CALIFORNIA: SOUTHWEST 
REGIONAL LABORATORY FOR EDUCATIONAL RESEARCH AND DEVEL- 
OPMENT, 1968. 



Purpose t This study investigated the relationship between 
cloze and multiple-choice test scores in grades five and eight 
when reading passage difficulties were two years below, two 
years above, and at subject's grade level. 



Princi7>les, Concepts, or Procedure s » Materials were drawn 
from the Rate Builders section of the SRA Reading Laboratory 
Kits. Between three and five questions were added to those 
following the selections. A mean ratio of 3:8 was maintained' 
between multiple-choice items and cloze deletions. 

Every-fifth-word deletions were made and five test forms 
constructed. Final data were obtained for 708 fifth graders 
and 708 eighth graders who had been assigned to either a cloze 
or a multiple-choice condition. At each grade level, matched 
pairs were assigned to passage difficulty levels. Within 
these levels 7 subjects were randomly assigned to one of fifteen 
selections at that level. 

All subjects were given 25 minutes to complete the two 
tests. California Achievement Test reading scores were ob- 
tained six months previously. 



Conclusions t Among the findings were the following t 

1. The overall performance of the eighth graders was 
superior to that of the fifth graders. 

2. The cloze test was sensitive to grade level but less 
sensitive to passage difficulty. 

3« • . • one should proceed cautiously when using 
cloze test scores as measures of comprehension 
(or predictors of MC test score magnitudes) un- 
til a more detailed analysis of what the cloze 
procedure is measuring and of grade and diffi- 
culty ranges at which the cloze procedure is an 
appropriate measure have been established. (21) 



122 



RANKIN, EARL FREDERICK, JR. "AN EVALUATION OF THE CLOZE PRO- 
CEDURE AS A TECHNIQUE FOR MEASURING READING COMPREHEN- 
SION." UNPUBLISHED PH.D. DISSERTATION, UNIVERSITY OF 
MICHIGAN, 1958. 



Purpose t The cloze procedure, devised by Taylor, is a word-de 
letion technique for constructing comprehension tests. Words 
to be deleted are selected mechanically and blank spaces are 
substituted. Subjects are instructed to predict from the re- 
maining context what word belongs in each space. 

The study was an evaluation of the validity, performance, 
and utility of cloze tests based on "general science material" 
used by participants in a college reading- improvement program. 
It was postulated that comprehension tests emphasizing the mea 
surement of either the substantive content of a message or the 
Interrelationships between ideas could be constructed by vary- 
ing the type of words deleted: the restriction of word dele- 
tion to nouns and verbs measures primarily the comprehension 
of substantive content. The postulate was confirmed, and this 
form of the cloze procedure was used in the investigation. 



Principles* Concepts, or Procedures ! Part I was a study of 
the validity of the cloze test as a measure of (1) general 
reading skill, (2) pre-reading and post-reading knowledge of 
the content of a specific article, and (3) "specific reading 
comprehension" (i.e., the gain between pre- and post-reading 
tests, attributable to learning through reading). The Diagnos 
tic Reading Tests » Survey Section was used as a criterion of 
general reading skill, and a multiple-choice test constructed 
for the purpose was used as a criterion of pre- and post-read- 
ing knowledge. Validity was ascertained both for the total 
sample and for sub-groups defined by status on the following 
organismic variables! (1) reading rate, (2) intelligence, (3) 
previous knowledge, (^) level of permeability, (5) level of 
anxiety, and (6) four personality types (defined by combina- 
tions of high and low status on the permeability and anxiety 
dimensions ). Personality measurements were made with the SA-S 
Senior Scales. 

In Part II, mean performance on pre- and post-reading 
tests and the "gain score" was studied as a function of the 
above organismic variables. 

In Part III, the usefulness of the procedure for the con- 
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struction of multiple forms of a test for measuring improve- 
ment in reading was considered. The equivalence of four 
cloze test forms was studied, and an attempt was made to de- 
termine the sensitivity of the test to change in reading com- 
prehension for the total group and for the aforementioned sub- 
groups. 



Conclusions « Correlations ranging from .29 to .48 were ob- 
tained between cloze tests and the survey test. Validity co- 
efficients of .59 and .56 were obtained for the tests as mea- 
sures of pre- and post-reading knowledge of a specific article. 
Significant differences were obtained between pre- and post- 
tests. It was concluded that this form of the cloze procedure 
produces tests which are not very accurate measures of general 
reading skill but are sufficiently accurate for measuring pre- 
and post-reading knowledge and "specific reading comprehension.' 

Pre-test reliability, validity, and mean scores were sig- 
nificantly higher for low permeable than for high permeable 
subjects. Such differences did not exist on the post-test. 
This outcome was interpreted as r reflection of the need of 
permeable individuals for structuu in making cloze responses 
and of the increased structure provided by reading an article. 

No differences were found between "gain scores" as a 
function of any organismic variable. Unlike other reading 
tests, this measure gives no advantage to individuals with 
high intelligence or pre-reading knowledge. 

Apparently, anxiety reactions to one test form yielded 
equivocal results in the improvement study. It was concluded 
that the use of multiple forms to measure sub-group differences 
in improvement is not desirable unless the equivalence of each 
form for the specified sub-groups is determined in advance or 
unless procedures can be devised to reduce such lack of equiva- 
lence. 



^Disserta tion Abstracts (Ann Arbor, Michigan! University 
Microfilms, 1958), Vol. 19, No. 4, pp. 733-734. (L. C. Card 
No. Mic 58-3722, 234 pages). 
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RANKIN, EARL P., AND CULHANE, JOSEPH W. "COMPARABLE CLOZE AND 
MULTIPLE-CHOICE COMPREHENSION TEST SCORES." JOURNAL OF 
READING . 13 (1969), 193-198. 



Purpose » The study was designed to replicate Bormuth's study 
relative to comparable scores on cloze and multiple-choice com- 
prehension tests. 



Principles. Concepts, or Procedures ! A pilot study preceded the 
nain study which included as subjects 105 fifth grade pupils. 
Five 50-item cloze tests and five 31-itein multiple choice tests 
were constructed over five World Book Encyclopedia articles 
which ranged in Fry readability from grade five to grade eight. 
The unmutilated passage and multiple-choice questions were ad- 
ministered four days after the cloze test. Only exact replace- 
ments were scored correct. 



Conclusions t Bormuth's findings were corroborated. A 75^ mul- 
tiple-choice score is roughly equal to a cloze score of ^ifrjS 
(Borrauth) or W (Rankin and Culhane) while a 90?^ jnultiple- 
choice score is roughly equal to respective cloze scores of 57% 
and 61% • 
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RANKIN, EARL P., AND DALE, LOTHAR H. "CLOZE RESIDUAL GAIN - 
A TECHNIQUE FOR MEASURING . LEARNING THROUGH READING." 
THE PSYCHOLOGY OP READING BEHAVIOR . EDITED BY G. B. 
SCHICK AND M. M. MAY. EIGHTEENTH YEARBOOK OP THE NA- 
TIONAL READING CONFERENCE. MILWAUKEE, WISCONSIN: 
NATIONAL READING CONFERENCE, I968, 17-26. 



Purpose t The authors investigated the cloze residual gain 
technique wherein the amount of knowledge learned by reading 
is separated from that known before reading. 



Principl es. Concepts, or Procedures » Subjects were 174 col- 
lege students. The materials consisted of an unmutilated 
article concerning temperature, two cloze tests made over the 
passage, and a multiple -choioe comprehension test. A struc- 
tural cloze test deleted every fifth word while a lexical 
cloze test deleted nouns and verbs. 

Each class involved was divided evenly with half taking 
a cloze teat followed by. the multiple-choice test and the 
other half taking these in reverse order. The unmutilated 
passage was not used until thirty days later after which the 
identical tests were re -administered to each subject. The 
Davis Reading Test was the standardized measure used. 



Conclusions « Among the findings were the following! 

1. Cloze is a sensitive measure of reading gain. 

2. Structural cloze reading gains are related to tests 

of post-reading knowledge and standardized reading tests while 
lexical gains are related only to post-reading knowledge. 
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RANKIN, EARL F.t AND HESS, ALLEN K. "THE MEASURET^ENT OF INTER- 
NAL (INTRA-ARTICLE) READING FLEXIBILITY." PAPER PRESENTED 
AT THE NATIONAL READING CONFERENCE, ATLANTA, GEORGIA, DE- 
CEMBER ^-6, 1969* 



Purpose : The effects of training on internal reading flexibil 
ity (intra-article flexibility) and the relationships between 
such flexibility and overall reading speed, reading comprehen- 
sion, anxiety level, and introversion-extraversion were inves- 
tigated* 



PrinciDles, Concepts, or Procedures : Flexibility coefficients 
were computed before and after training for the total group of 
255 college subjects and for sub-groups of 12? subjects who 
fell in the top or bottom half of the distribution for reading 
speed. Desensitizing exercises were employed to allow subjects 
to adapt to the reading interruptions necessary to measure 
internal flexibility. Subjects were enrolled in a college read 
ing progranit Pretest and post-test measures were made with 
alternate forms of the Diagnostic Reading Test: Survey Section . 
Test passage difficulty was determined by the cloze technique. 
Anxiety level and introversion-extraversion were measured by 
the SA-S Senior Scales. 



Conclusions : Results indicated that it was possible to desensi- 
tize subjects to allow for measuring internal flexibility. How- 
ever, the statistical procedures used and/or the restricted 
range of reading ability and reading difficulty of the selec- 
tions may have obscured between group differences of flexibility 
coefficients. References are included. 1 



Research in Education (Washington, D.C.: United States 
Government Printing Office, 1970), Vol. 5t No. 8, p. 89. 
(ED 038 21^7. 14 pages). 
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RUDDELL, ROBERT BYRON. "AN INVESTIGATION OF THE EFFECT OF THE 
SIMILARITY OF ORAL AND WRITTEN PATTERNS OF LANGUAGE STRUC- 
TURE ON READING COMPREHENSION." UNPUBLISHED ED.D. DISSER- 
TATION, INDIANA UNIVERSITY, I963.I 



Purpose ! The purpose of this study was to investigate the 
effect of the similarity of oral and written patterns of lan- 
guage structure on reading comprehension of fourth grade chil- 
dren* 



Principl es, Concepts, or Procedures ; Two research hypotheses 
were designed for the purpose of this investigation. These 
hypotheses were: (1) The degree of comprehension with which 
written passages are read is a function of the similarity of 
oral patterns of language structure to written patterns of 
language structure in reading passages. (2) The comprehension 
scores on reading passages that utilize high frequency patterns 
of oral language structure will be significantly greater than 
the comprehension scores on reading passages that utilize low 
frequency patterns of oral language structure. Six exploratory 
questions were designed to investigate the effect of subject 
background variables on comprehension scores over written ma- 
terial that utilizes high and low frequency patterns of oral 
language structure. These variables consisted of the occupa- 
tional status of the father, the educational background of the 
parents, and the intelligence, mental age, chronological age, 
and sex of the subjects. 

A series of structurally controlled reading passages hav- 
ing a wide range of similarity indexes were designed to test 
the hypotheses. These indexes were determined by assigning 
empirically determined frequency values of oral patterns of 
language structure of fourth grade children to identical writ- 
ten patterns of language structure in the reading passages and 
totaling the assigned frequency values. The empirically de- 
termined frequency values of the oral language patterns of 
fourth grade children were obtained through calculations based 
on data collected in a study by Strickland. Vocabulary diffi- 
culty, sentence length, specific subject-matter content and 
passage length were equated in the reading passages. Cloze 
comprehension tests were constructed over the reading passages 

^See also Robert B. Ruddell, "The Effect of Oral and 
Written Patterns of Language Structure on Reading Comprehen- 
sion," Appendix. 
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*x 

and administered to 131 randomly selected subjects on the 
fourth grade level in the Blooinington Metropolitan School 
System, Bloomington, Indiana. Pertinent background data were 
obtained from parents and teachers. A one-way and two-way 
analysis of variance using a repeated measurement design and 
the statistic Epsilon were employed in the treatment of data. 



Conclusions; Highly significant differences (beyond the .01 
level) were found between comprehension scores thus support- 
ing the two research hypotheses. Significant differences 
were found in comprehension scores over reading passages 
utilizing high and low frequency patterns of oral language 
structure in relation to all subject background variables 
with the exception of the sex variable. An interaction sig- 
nificant at the .05 level was found in relation to the sex 
variable . 

The conclusions related to the two research hypotheses 
were J (1) Reading comprehension is a funcxion of the similar- 
ity of oral patterns of language structure to written patterns 
of language structure used in reading materials. (2) Reading 
comprehension scores over materials that utilize high fre- 
quency patterns of oral language structure are significantly 
greater than reading comprehension scores over materials that 
utilize low frequency patterns of oral language structure. 
The conclusions related to the exploratory questions stated 
that the occupational status of the father, the educational 
background of the parents, and the intelligence, mental age, 
and chronological age of the subjects are significantly re- 
lated (.01 level) to reading comprehension over reading mate- 
rials that utilize high and low frequency patterns of oral 
language structure. Sex differences are not significantly re- 
lated to reading comprehension though there is some evidence 
to suggest that boys have disproportionally greater difficul- 
ty than girls in comprehending reading material written with 
low frequency patterns of oral language structure.! 



^ pigsertation Abatracta (Ann Arbor, Michigan i University 
Microfilms, 1964), Vol. 24, No. 12, Part I, pp. 5207-5208. 
(Order No. 64-3826, 20? pages). 
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SAWYER, niTA, AND ERAAM, LEONARD S. "AN EXPERIMENT COMBINING 
0L02E PROCEDURE WITH SPEED OF COMPREHENSION INSTRUCTION." 
PROCEEDINGS OF THE COLI^IGE READING ASSOCIATION . EDITED 
BY CLAY A. KETCHAM. SYRACUSE, NEW YORK: COLLEGE READING 
ASSOCIATION, 1964, 27-33. 



Purpose I The authors report an investigation into the effect 
of instruction in speed of comprehension upon reading compre- 
hension developed from practice with cloze exercises. 



Principles. Concepts, or Procedures t A group of 13^^ college 
freshmen were divided into one control and two experimental 
groups. Speed was developed by instructing students to be 
"flexible" in their reading. The Power Builders of the SRA 
Reading Laboratory were used. 

For developing comprehension, one control group used 
college type reading improvement material and answered the 
usual types of questions. 

The experimental group used cloze materials which were 
graded into nine levels. Each selection of 500 words had two 
cloze forms— unmutilated and every-tenth-word deletions. De- 
pending on progress, a subject could complete the materials 
in a minimum of 27 or a maximum of kd lessons. Subjects 
scanned the unmutilated selection for one minute before com- 
pleting the mutilated form. Both synonyms and exact replace- 
ments were accepted. Students and instructor discussed re- 
sponses at variance with the expected replacements. 

The second control group was given no SDecial reading in- 
struction. All groups were administered the' Cooperative Read - 
ing Test at the beginning and end of the semester. 



Cwclusipngi The experimental group achieved higher gains in 
^eed of comprehension than did control group one, a compar- 
able group verbally, or than did control group two, a more 
skilled group verbally according to ACE scores. 

"... work on speed of comprehension is not antithetical 
to work with cloze exercises and . . . the two can be combined 
to give, greater reading power." (33) 
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SIKES, HELEN CRUSE. "A COMPARATIVE STUDY OP CLOZE PROCEDURE 
SCORES ON ORIGINAL AND PUBLISHED MATERIALS." UNPUB- 
LISHED ED.D. DISSERTATION, UNIVERSITY OF SOUTHERN MISSIS- 
SIPPI, 1971. 



Purpose : This study was designed to compare the readability 
of creative stories written by children with that of published 
materials. The following three aspects of readability were 
considered! (1) vocabulary load, (2) interest, and (3) com- 
prehension. 

The problem, or comparison is examined according to the 
following questions: Does a significant difference exist be- 
tween original and published children's reading materials in 
vocabulary usage and degree of personal references? Is there 
a significant difference between children's comprehension 
scores on original and published materials as measured by the 
Cloze procedure reading test? Do comprehension scores obtained 
on a standardized reading test show a relationship to those 
resulting from the child's responses of cloze procedure tests? 



Princirles. Concepts, or Procedures ; Two groups of children 
were involved in the study. Group 1 was composed of 222 fifth 
and sixth grade students at Hazel Park Elementary School, and 
Group II was comprised of 224 fifth and sixth grade students 
at Bridgedale Elementary School. Both schools are in Jefferson 
Parish, Louisiana. 

In March, 1970, the comprehension section of the Gates - 
MacGinitie Reading Test was administered. A "t" test revealed 
no significant difference between means for the two groups. 

At Hazel Park, eighty children scored between grade 
levels 5*5 and 6.5. A table of random numbers was used to se- 
lect twenty-five of these students to write original stories. 

At Bridgedale, ninety children scored between 5.5 and 6.5 
grade levels. Fifty of these students (five groups of ten 
each) were randomly selected to take cloze tests. 

Five selections were used to construct cloze passages. 
The length of each passage was approximately 250 running words 
and contained fifty items in that every fifth word was deleted 
and substituted with a blank. 



Materials came from three sources: (1) SRA, (2) original 
stories, and (3) published materials, A practice test was con- 
structed from the SRA material • It was not scored or used in 
the data analysis • Four tests, two original stories randomly 
selected and two published materials of the same grade equiva- 
lent, were constructed into five forms each. 

The twenty tests were stacked in random order with regard 
to group and passage. They were administered to the fifty stu- 
dents in Group II, one a day for five consecutive days. The 
groups were staggered with regard to the time of day that the 
tests were taken. 

The tests werft scored for exactness in replacement of 
original word. 



Conclusions : Hypothesis 1 stated that there would be no sig- 
nificant difference in the number of words not included in the 
Dale List of 3,000 Familiar Words vhen children's original 
stories were compared with published materials. To test this 
hypothesis, the "t" test for independent groups, or uncorre- 
lated measures, was used. This hypothesis was retained. 

Hypothesis 2 specified that there would be a significant 
difference in the number of personal inferences when chil- 
dren's original stories were compared with published materials. 
The obtained "t" of ^.1398 between personal inferences for pub- 
lished and original stories was greater than the 2.71 need to 
be significant at the .01 level of confidence. Therefore, the 
null hypothesis of no difference was rejected. 

Hypothesis 3 stated that there would be a significant 
difference in comprehension scores, as measured the cloze pro- 
cedure, comparing original and published children's reading 
materials. The obtained F of 22.^8 for treatments was greater 
than the table value of 3 '9^ at the .61 level of confidence. 
Therefore, the null hypothesis was rejected. 

Hypothesis ^ was retained. There was no significant re- 
lationship between cloze procedure test scores. and Gates- 
MacGinitie comprehension scores at the .05 level of confidence. 
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The results of the study indicated that students compre- 
hend material written by their peers over published materials 
with a greater degree of accuracy and understanding.! 



J-Pissertation Abstracts Intern ational Ai The Hum anltipa 
^nd Social Sciences (Ann Arhnr. mnh^^^y,. University Micro- 
films, 1971), Vol. 32, No. 5, p. 2320-A. (Order No. 71-28,8/^7, 
171 pages;. 
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SMITH, WILLIAM LEWIS. "THE EFFECT OF SYNTAX ON READING." UN- 
PUBLISHED PH.D. DISSERTATION, THE FLORIDA STATE UNIVER- 
SITY, 1969. 

Purpose : The purpose of the present research was to deter- 
mine whether more mature syntactic structure increases reading 
difficulty, or whether all students, regardless of grade level, 
have the same syntactic skills and thus do read with equal 
facility material written at different levels of syntactic 
maturity, providing the vocabulary and content are held con- 
stant. 

Principles. Concep ts, or Proc edures t Two sets of test instru- 
ments were constructed for this research, each consisting of 
passages written at four levels of syntactic maturity: 4th 
grade, 8th grade, 12th grade, and Skilled Adult. The levels 
were established using the findings from recent research on 
the syntactic maturation of school children's writing. 

The cloze technique was used to test reading comprehen- 
sion. For each set of test instruments, all combinations of 
the every- fifth word" deletion pattern were employed. 

Two experiments were conducted, each using a different 
set of instruments. The same subjects were used in both ex- 
periments although there was a 695 attrition in the second ex- 
periment. Prom each of the grades k through 12, groups of 
30 subjects were randomly selected, each of the groups being 
administered test instruments at one of the 4 levels of writ- 
ing. 

It was hypothesized that, in each experiment, there would 
be no significant dif f er».nces » 1) in comprehensibility be- 
tween the 4 levels of writing at each grade level of reader, 
and 2; in comprehension between the 9 grade levels of readers 
on each level of writing. 

Conclusions! Statistical analysis showed that only the 4th 
grade subjects significantly (.05) distinguished between the 
four levels of writing in both experiments. They read the 4th 
grade writing better than either the 8th grade or Skilled 
Adult writing. However, in both experiments the older subjects 
ipades 10, 11, and 12) consistently read all levels of writing 
significantly (.01) better than younger subjects (grades 4. 5. 
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A critical analysis of the data revealed that, in both ex- 
periments, the subjects in grades 4, 5, an<? 6 read the 4th 
grade writing best while the subjects in grades 8 through 12 
read the 8th grade writing best. Furthermore, the older sub- 
jects read the 4th grade writing less well than they read all 
other levels. The data implied, therefore, that older sub- 
jects read syntactically more complex material with greater 
comprehension than they read less complex material. A tenta- 
tive hypothesis was proposed foi this phenomenon. 

Pour conclusions were drawn from this research: 

1. For students in grades 4, 5, and 6, 4th grade writing 
appears to be easier to read than writing by more mature stu- 
dents. But for older students, 4th grade writing Is not the 
easiest. 

2. The more mature students (grades 8 through 12) find 
8th grade writing easier to comprehend than either the simpler 
4th grade writing or the more complex writing of the 12th 
graders or Skilled Adults. 

3. Since 4th grade writing is the most redundant, word 
predictability (which is what the cloze technique measures) 
is more than a function of grammatical redundancy for the 
middle and upper grades. However, for the lower grade stu- 
dents, redundancy may be the only factor. This phenomenon is 
open for speculation. 

4. The high correlation (.82) between the results of the 
two experiments indicates that the controlled instrument tech- 
nique used m this study may provide an effective and simple 
tool for future research. 



I 
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^ -^Dissertation Abs tracts International A: The Humanities 
and Social Sciences (Ann Arhnr^ Mirhigan. University Micro- 
ta^oll.^'^lV' Vol. 30, No. 11, pp. 4970-A, 4971-A. (order No. 
70-8575t 134 pages). 
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SWAIM, JAMES E. "COMPARISON OP ORAL READING, SILENT READING. 
AND LISTENING COMPREHENSION ASSESSED BY CLOZE." UNPUB- 
LISHED ED.D. DISSERTATION, RUTGERS UNIVERSITY. THE STATE 
UNIVERSITY OF NEW JERSEY, I97I. 

Purpose t The purpose of this study was to determine the 
effect upon comprehension of oral reading, silent reading, and 
listening when using material that had a readability level 
equal to the grade level of the students being tested in sec- 
ond, third, and fourth grades. 

Principles. Conce pts, or Procedures : A separate story was used 
for each grade. It was anticipated that the results from this 
investigation would have applicability to instructional proce- 
dures in regular classrooms for the grade span studied. 

Comprehension was measured by means of the cloze technique. 
A 10 percent random deletion pattern, omitting only lexical 
words, was used in making the deletions from the stories. Stu- 
dents completed the test using the same method of response as 
they had used in learning. 

The sample population was composed of 324 students, 108 
from each grade. They were assigned to the three testing 
methods by a process of stratified randomization. Thirty-six 
students were included in each testing group within a grade: 
12 each from the above -aver age, average, and below-average 
groups, respectively, ^ 

Two null hypotheses were tested. The first was that there 
would be no difference in the comprehension of material read 
orally, read silently, or listened to on tape in the three 
grades. The second hypothesis was that there would be no dif- 
ference m the level of comprehension for the above -aver age, 
average, or below-average reading categories for the three 
methods m the three grades. Statistical analysis of the data 
was done through the analysis of variance formulas and Tukey's 
Honestly Significant D ifference Test . The significance level 
•for the investigation was established at .05. 

gonclusions: The results for the first hypothesis showed 
that significant differences among the three methods existed 
®?J? ^"'^^fecond grade. In this instance, oral reading was sig- 

5MiS^"^i^*^®^ir reading or listening. At 

third and fourth grades, no significant differences were noted 
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among the three methods* 



The results for the second hypothesis showed that the 
reading level of the student was important for determining 
comprehension effectiveness with the three methods in each 
grade. Above-average students exhibited a strong tendency 
to comprehend better when reading than they did when listen- 
ing, with significance being reached in second and fourth 
grades. At second grade both reading approaches were equally 
effective, while at third and fourth grades silent reading 
was slighijly better than oral reading. The students with 
average reading ability comprehended equally well with the 
three methods of learning regardless of grade. 

For the below-average students, listening became the most 
effective method for comprehension, followed by oral reading 
and then silent reading. Listening was significantly higher 
than silent reading at all three grades, but significantly dif- 
ferent from oral reading at only third grade. Hence, there 
was a tendency for listening and oral reading to be about the 
same in comprehension effectiveness for this group, especially 
at second and fourth grades. 

The following conclusions were drawn from the results of 
this investigation. When the students* reading abilities were 
above the difficulty level of the article, they comprehended 
better with some form of reading than they did with listening. 
When the students* reading abilities and the readability level 
of the article were about the same, the three learning methods 
resulted in about the same amount of comprehension. When the 
students* reading abilities were below the difficulty level of 
the article, listening was better for comprehension purposes 
than silent reading. There was also a tendency exhibited with 
below-average readers for oral reading to follow listening in 
comprehension effectiveness at the second and fourth grades. 1 



^ Dissertation Abstracts International At The Humanities 
I and Soci al Sciences (Ann Arbor. Minhigant University Micro- 

films, 19''2), Vol. 32, No. 7, pp. 3578-A, 3579-A. (Order No. 
I 72-1102, 160 pages). 

i 
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TAYLOR, WILSON L. '•CLOZE READABILITY SCORES AS INDICES OF IN- 
DIVIDUAL DIFFERENCES IN COMPREHENSION AND APTITUDE." 
JOURNAL OF APPLIED PSYCHOLOGY . 41 (195?), 19-26. 



Purpose : 

This experiment specifically tested the hypothesis 
that the cloze scores of individual subjects would 
correlate significantly with their performances on 
(a) carefully constructed preknowledge and immedi- 
ate-recall tests of the content of the material pre- 
sented, and (b) a standardized aptitude or "intelli- 
gence" test of supposed "ability to understand." (19) 



Principl es, Concepts, or Procedures ; Three cloze forms— 
••any," "easy," and "hard"— were prepared from a 2Qfo sample of 
an Air Force technical article. "Before" versions of each 
form and a pre-test of comprehension were administered to the 
approximately 58 in each of three sections. About a week 
later, the complete article was distributed for study, and 
the recall test of comprehension and the "after^^ cloze ver- 
sions of each cloze form were administered. Only exact-word 
replacements were counted in the scoring. All subjects had 
Armed Forces Quali fication Test scores on record as a measure 
of mental ability. 



Conclusions t 

For each of the three groups, correlation coeffi- 
cients Were computed between all 10 possible pair- 
ings of five distributions of scores (before- and 
after-study cloze, pre- and post-tests of compre- 
hension, and AFQT). All 30 such coefficients were 
found to be positive and significant to beyond the 
.001 level of confidence. (26) 
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WEAVER, WENDELL; KINGSTON, ALBERT J.; BICKLEY, A. C; AND 

WHITE, WILLIAI^i F. "INFORMATION-FLOW DIFFICULTY IN RELA- 
TION TO READING COMPREHENSION." JOURNAL OF READING BE - 
HAVIORf 1 (1969)1 ^1-^9. 



Purpose s 

This study explores certain of the relations be- 
tween a reading cc^ '•ehension measure t accuracy of 
communication mei . (the cloze tests )f associa- 
tion and rote leSi - ..1^ taskSf and personality and 
attitudinal varia - (^3) 



PrincipleSt Concepts, t P rocedures : Subjects were 53 college 
sophomores who were adm.i/ldtered The Davis Reading Test , The 
Modern Language Antitude Test t the Cattell 16 PE t and the 
Semantic X Differential * Two oloze tests were made over a 
reading passage — on^^ after and one before the passage was read. 
Two rating scales of bi -polar adjectives were also adminis- 
tered. 



Conclusions : 

The results of this study provide further evidence 
for the interrelationships of rote learning pro- 
cesses and so-called higher level mental processes. 
The best predictors of reading comprehension and 
post-cloze scores are sub-tests of the KLAT which 
require the subject to learn by rote material with 
which he has little or no previous familiarity. . . . 
(^7) 



CHAPTER IV 



THE CLOZE PROCEDURE AS A MEASURE 
OP LANGUAGE FACILITY 

The cloze procedure has permitted researchers to use 
the language of individuals to illustrate characteristics of 
certain personality and physical disorders. 

In using the cloze procedure with deaf and hearing 

people, Cohen studied a population of children and adults 

to compare the redundancy of story paraphrases written by 

deaf and hearing children, to determine their facility in 

making use of this redundancy to reconstruct the paraphrases, 

2 

Marshall investigated the effect of contextual 

constraint on deaf and hearing fourth grade children, and 
3 

Moores applied the cloze procedure to an assessment of 



Sandra Ruth Cohen, "Redundancy in the Written Lan- 
guage of the Deaf: Predictability of Deaf and Hearing 
Story Paraphrases" (unpublished Ph.D. dissertation, Colum- 
bia University, 1964). 

''William James Aloysius Marshall, "Investigating 
the Effect of Contextual Constraint on Deaf and Hearing 
Children at the Fourth Grade Reading Level, Using the Cloze 
Procedure" • (unpublished Ed.D. dissertation. University of 
Illinois at Urbana-Champaign, 1970). 

^Donald Frederick Moores, "Applications of 'Cloze* 
Procedures to the Assessment of Psycholinguist ic Abilities 
of the Deaf" (unpublished Ph«D. dissertation. University 
of Illinois, 1967). 
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the psycholinguistic abilities of deaf children. 

Specific problems related to speech have been 

studied by means of the cloze procedure. Fillenbaum and 
1 

Jones applied the technique to a study of aphasic speech. 
2 

Honigfeld evaluated the effect of drugs on speech, and the 
ability of schizophrenics to understand normal, psychotic, 
and pseudo-psychotic speech. 

Attitude and personality studies have been facili- 
tated by app.lications of the cloze procedure. Attitudes of 

college students toward capital punishment were studied by 

3 ^ 
Manis and Dawes. Honigfeld, Platz, and Gillis investi- 
gated the relationship between authoritarianism and verbal 
style. The relationship between reading test reliability 
and validity, and introversion-extroversion of college 

let 

Samuel Fillenbaum and Lyle V. Jones, "An Applica- 
tion of 'Cloze* Technique to the Study of Aphasic Speech," 
Journal of Abnormal and Social Psy chnlnfyy^ 55 (1962), 
183-189* 

^Gilbert Honigfeld, "Effect of an Hallucinogenic 
Agent on Verbal Behavior," Psychological Reports . 13 (1963), 
383-3851 Gilbert Honigfeld, "The Ability of Schizophrenics 
to Understand Normal, Psychotic, and Pseudo-Psychotic 
Speech," Diseases of the Nervous System. 24 (I963), 692- 
694 • 

Kelvin Manis and Robyn M. Dawes, "Cloze Scores as 
a Function of Attitude," Psychological Reports . 9 (196I). 
79-84. ' 

4 

H?,^^?^!"^ honigfeld, Arthur Plata, and Roderic D. 
Gillis, "Verbal Style and Personality 1 Authoritarianism," 
Journal o f Communication . 14 (1964), 215-216. 
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students has boen investigated by Rankin.^ 

Other studies have utilized the cloze procedure to 

investigate the grammar and syrtax of the English language. 

2 

Coleman and Blumenfeld compared nominalized sentences 

with their grammatical transformations for comprehensibility, 
3 

louthan studied the effects on comprehension of various 

systematic grammatical deletions. 

4 . 
Clark and Clark, Williams, and Tannenbaum inves- " 

tigated, by means of the cloze procedure, the agreement 

between encoders and decoders with respect to syntactic 

and referential information. The ability of encoders and 

decoders in predicting omissions was also investigated by 

«. ^1 ^Rankin, "Reading Test Reliability and Validity as 
Function of Introversion-Extroversion," Journal of Dev elop- 
mental Reading . 6 (I963), IO6-II7. ~~ ^ 

. B, Coleman and J. P. Blumenfeld, "Cloze Scores 
of Nominalizations and Their Grammatical Transformations 

2?i f.r^*^''^^^® Verbs," Psychological Reports . 13 (I963), 
o5j -654. 

3 

Vincent Louthan, "Some Systematic Grammatical De- 
letions and Their Effects on Reading Comprehension," 
English Journal. 54 (I965), 295-299. 

if 

D * i^® Clark, "The Influence of Syntactic and 

Referential Information on Word Predictability- (unpub- 
lished Ph.D. dissertation. The University of Wisconsin, 
19o4; . 

^Ruth Anne Clark, Frederick Williams, and Percy H. 
Tannenbaum, "Effects of Shared Referential Experience Upon 

oSS^Sfo'^®*^®*^®^ Agreement," Language and Speech . 8 (I965), 
253-262. 
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Weaver and Bickley. 

To determine whether differences existed in the pre- 
dictability of lexical and structural deletions, Weaver 

•5 

applied the cloze procedure. Weaver and Kingston investi- 
gated the relationship of cloze tests to a number of se- 
lected measures of language ability. 

Comparative differences between oral and written 
samples of prose were studied by DeVito. 

Several studies have utilized the cloze procedure 
to investigate language characteristics of educable mentally 
retarded children. Brooks hypothesized that non-intellec- 
tual factors, such as personality variables, have a signifi- 



Wendell W. Weaver and A. C. Bickley, "Some Differ- 
ences in Encoding and Decoding Messages," Journal of the 
Reading Specialist . 7 (196?), 18-25.. " ~~ 

Wendell William Weaver, "An Examination of Some 
Differences in Oral and Written Language Using the Cloze 
Procedure" (unpublished Ed.D. dissertation. University of 
Georgia, 1961). 

Wendell W. Weaver and Albert J. Kingston, "A Fac- 
tor Analysis of the Cloze Procedure and Other Measures of 
Reading and Language Ability," Journal of Communication . 
13 (1963), 252-261. 

Joseph A. DeVito, "Comprehension Factors in Oral 
and Written Discourse of Skilled Communicators," Speech 
Monographs . 32 (I965), 124-128. 



-'Sadye Tune Brooks, "Effects of Locus of Control 
and Anxiety on the Ability of Mentally Retarded Children 
to Use Context Clues in Reading" (unpublished Ph.D. dis- 
sertation, George Peabody College for Teachers, 1962). 
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cant effect on the reading behavior of mentally retarded 
children. 

The grammatical ability of these children was 

studied by Semmel, Babbitt, and Bennett,^ while their oral 

2 

language proficiency was assessed by Goodstein. Ramanaus- 
3 

kas assessed the sensitivity of educable mentally retarded 

children to contextual constraints beyond a sentence. 

The cloze procedure has also found application in 

4 

studies of listening comprehension. Carver et al . inves- 
tigated sources of individual differences in listening 
comprehension by means of speech samples and cloze testing, 



Melvyn I. Semmel, Loren S. Babbitt, and Stanley W. 
Bennett, "Performance of EMR and Nonretarded Children on a 
Modified Cloze Task," American Journal of Mental Defic iency 
74 (1970), 681-688. ^ 

2„ 

Henry Arthur Goodstein, "The Performance of Edu- 
cable Mentally Handicapped and Average-IQ Children on Two 
Modified Cloze Tasks for Oral Language" (unpublished Ph.D. 
dissertation. The University of Connecticut, 1969). 
3 

Sigita Ona Ramanauskas, "The Effect of Contextual 
Constraints Beyond a Sentence -m Cloze Responses of Chil- 
dren in Special Classes for the Educable Mentally Retarded" 
(unpublished Ph.D. dissertation. The University of Connec- 
ticut, 1971). 

4 

Ronald P. Carver, et al .. "Factor Analysis of the 
Ability to Comprehend Time-Compressed Speech" (paper pre- 
sented at the Annual Meeting of the American Educational 
Research Association, New York, N. Y. , February 4-7, 1971. 



144 

while Williams^ applied the semantic differential and the 
cloze procedure to a study of listening comprehension 
when tape-recorded materials were used. 
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cfltlon "An Experimental Appli- 

cation of the Semantic Differential and 'Cloze* Procedure 

2!M?fS"r2u"35 in Listening Comprehension- (un- 

published Ph.D. dissertation, Urlversity of Southern Cali- 
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BROOKS, SADYE TUNE. "EFFECTS OF LOCUS OF CONTROL AND ANXIETY 
ON I'HE ABILITY OF MENTALLY RETARDED CHILDREN TO USE CON- 
TEXT CLUES IN READING." UNPUBLISHED PH.D. DISSERTATION. 
GEORGE PEABODY COLLEGE FOR TEACHERS, 1962. 



Purpose ; The primary purpose of this study was to determine 
the effects of locus of control and anxiety-as-drive on the 
ability of mentally retarded children to use context clues in 
reading. On the assumption that these variables were some- 
what different attributes of personality in the mentally re- 
tarded population, it was reasoned that combined effects of 
the variables would eventuate in specific predictable be- 
haviors in reading. 



Principles. Concep ts, or Procedures » Sixty educable mentally 
retarded children of both sexes were selected from the elemen- 
tary grades of a State residential school for dependent chil- 
dren to serve as Ss. Four groups were equated on IQ, locus of 
control and manifest anxiety using scores from the Peabodv 
Picture Vocabulary Tpst, the Bialer-Cromwell Children 's T.nntis 
of Control Scale, and the Ch ildren's Manifest Anxiety Scale . 
The CA range was 9-2 to 1.5-6 with a mean of 12-8} IQ, 55 to 85, 
with a mean of 73.^5? and, MA 6-jj to 11-i^, with a mean of 8.6. 
The mean locus of control score for -^ll Ss was 13.40 and the 
mean anxiety score was 25.03. Four • ub^oups of 15 Ss each 
were studied: e.g., internal locus of control with high anxiety, 
internal locus of control with low anxiety, external locus of 
control with high anxiety, and, external locus of control with 
low anxiety. 

All subjects were individually administered the following 
treatments!! (a) A reading pretest was administered to estab- 
lish each S's basal (easy) and frustration (difficult) reading 

frade levels, (b) A sequence of three cloze procedure passages 
context clue tests) equivalent to the S's basal reading grade 
level was administered. This sequence was accompanied by in- 
creasing monetary rewards and was defined as a success experi- 
ence, (c) A sequence of three cloze procedure passages equiva- 
lent to the S*s frustration reading grade level was adminis- 
tered. This sequence was accompanied by decreasing laonetary 
rewards and was defined as a partial failure experience. 



Cgnclusionst Analysis of varianre was used to analyze cloze 
procedure scores. A correct response was defined as having 
supplied the correct word in a reading passage from which every 
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fifth word had been replaced by a blank space. As predicted, 
the total group deiuonstrated a significant increment in per- 
formance on Sequence I under conditions of easy tasks and in- 
creasing monetary reward. Contrary to predictions, on Sequence 
lit under conditions of difficult tasks and decreasing monetary 
rewards the total group demonstrated a significant increment 
in performance. The magnitude of the increment on Sequence II 
was even greater than the increment on Sequence !• An analysis 
of gain scores of the four subgroups revealed an interaction 
effect between locus of control and anxiety. The gain scores 
of the internal locus of control with high anxiety Ss were sig- 
nificantly lower than the gain scores of all other groups. The 
combined effects of internal locus of control and low anxiety 
contributed to the best performance. Within the internal locus 
of control group, anxiety apparently played a significant role, 
and within the high anxiety group, loous of control played a 
significant role. However, within the external locus of con- 
trol group, anxiety did not influence results significantly, 
and within the low anxiety group, locus of control did not con- 
tribute to a significant degree. Contrary to predictions, the 
analysis of shift scores ^rom easy sequence to difficult se- 
quence (Task 3-Task 4) revealed no significant differences be- 
tween groups. However, the shift scores within each subgroup 
revealed a significant decrement in performance in shifting 
from easy to difficult tasks with the exception of the internal 
locus of control with high anxiety group which showed a nonsig- 
nificant decrement in performance. 

The results of the study supported the primary thesis of 
the study, i.e«, nonintellectual factors, such as personality 
variables, do play a significant role in the reading behavior 
of educable mentally retarded children. The data suggested 
that a factor analytic approach to identifying group factors 
that influence reading behavior seemed warranted. 1 



'' "Dissertation Abstracts (Ann Arbori Michigan i Univer- 
sity Microfilms, 1962), Vol. 23f No. 6, pp. 2003-200^. (Or- 
der No. 62-5667f I4l pages). 
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CARVER, RONALD P. ET_AL. "FACTOR ANALYSIS OF THE ABILITY TO 
COMPREHEND TIME-COMPRESSED SPEECH." PAPER PRESENTED AT 
THE ANNUAL MEETING OF THE AMERICAN EDUCATIONAL RESEARCH 
ASSOCIATION, NEW YORK, N. Y., FEBRUARY ^^-7, I97I, 



Purpose ; Sources of individual differences in the listening 
comprehension of speech presented at different rates were in- 
vestigated by factor analyzing 11 variables, including measures 
of comprehension and f ield-independencv. 



Principl es. Concepts, or Procedures » Twenty- two different 
tests, two for each variable, were administered to 50 college 
students. 



Conclusions : It was concluded that: (a) the cloze type of 
test includes a large component of variance unrelated to com- 
prehension and quite specific to the technique itself, and 
(b) the comprehension of highly speeded speech probably in- 
volves a perceptual ability to be field-independent in addition 
to a separate ability involved in comprehending speech at nor- 
mal rates. 1 



Research In Education (Washington, D.C. t United States 
Government Printing Office, 1971), Vol. 6, No. 4, p. I63. 
(ED 0^5 702, 18 pageis . 
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CLARK, RUTH ANNE. '•THE INFLUENCE OF SYNTACTIC AND REFEREN- 
TIAL INFORMATION ON WORD PREDICTABILITY." UNPUBLISHED 
PH.D. DISSERTATION, THE UNIVERSITY OF WISCONSIN, 1964. 



Purpose; The primary purpose of the present study was to in- 
vestigate the effects of syntactic and referential information 
upon the predictability of semantic and function words in 
descriptive and interpretative messages. Predictions of re- 
lationships among the independent variables were summarized in 
the following two hypotheses « 

Hypothesis 1 1 Syntactic information enhances v/ord pre- 
dictability, and does so to a greater extent for function 
words than for semantic words* 

Hypothesis II i Referential information enhances word pre- 
dictability, with greater effect on semantic words than on 
function words, and to a greater extent in descriptive than 
in interpretative messages. 



Principles. Conce pts, or Procedures » The four independent 
variables— syntactic and referential information and message and 
word type— were related in a 2x2x2x2 analysis of variance model. 
Eight groups of 20 Ss (college students) attempted to replace 
missing words of both types. Each group reconstructed messages 
in one experimental condition, the experimental conditions be- 
ing defined by all possible combinations of syntactic and re- 
ferential information and message type. In the primary analy- 
sis, measures of word predictability were verbatim replacement 
of the original word (V), correct form class replacements (^C), 
and the ratio of V/FC . Two additional analyses were performed t 
U; the influence of the independent variables upon entropy or 
dispersion of decoders' responses, necessarily using words 
rather than Ss as replicates, was determined? (2) the effects 
of syntactic and referential information and message type on V, 
FC, and V/FC were tested for words of each grammatical class. 



Conclusions » Hypothesis It Providing syntactic information 
significantly increased V and FC, in addition to bringing de- 
coders responses into closer agreement. Since the rise was 
greater for FC than V, V/FC decreased. V scores were signifi- 
cantly influenced, however, only in the case of function words. 

Hypothesis II j Referential information caused a signifi- 
cant increase in V and V/FC and lessened dispersion among 



decoders • responses. Since referential information had no 
effect on FC, V/FC increased when the message stimulus was 
supplied. Referential information did increase the predicta- 
bility of semantic words more than function words, but did 
not have a differential effect according to message type. 

Major implications of the present research were related 
to both theory and methodology relevant to investigation of 
semantic and sjmtactic constraints in decoding behavior.^ 



Dissertation Abstracts (Ann Arbor, Michigan: Univer- 
sity Microfilms, 196^), Vol. 25» Nc. 6, p. 3738. (Order No. 
64-13,863, 14? pages). 
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CLARK, RUTH ANNE; WILLI ATJIS. FREDERICK; AND TANNENBAUM, PERCY H. 
-EFFECTS OF SHARED REFERENTIAL EXPERIENCE UPON ENCODER- 
DECODKR AGREEr.lENT." LANGUAGE AND SPE ECH. 8 (I965), 253- 



Purpose I "The effects of referential experience upon encoder- 
decoder agreement were studied. ..." (253) 



Principl es* Concepts, or Procedures : One hundred sixty under- 
graduate students were administered passages of approximately 
180 words in which every fifth word had been deleted. Subjects 
were not told if the encoders had given descriptions or inter- 
pretations of the five paintings used in the study, and were 
simply instructed to replace the words which they thought the 
encoder had used. Responses were scored on the basis of exact- 
word and form class replacements. 



Conclusions: 



1. . . .the decoder group having the paintings 
available . . , Showed/ a higher agreement with the 
encoder . . . than the group without the paintines 

. . (256-257) 

2. . . there was no significant difference between 
these two conditions with respect to grammatical re- 
placement. ..." (257) 

3* . . the expected difference on the effect of 
shared referential information as between descriptive 
and interpretative messages failed to materialize." 
(257) 
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COHEN, SANDRA RUTH. "REDUNDANCY IN THE WRITTEN LANGUAGE OF 
THE DEAF: PREDICTABILITY OF DEAF AND HEARING STORY 
PARAPHRASES." UNPUBLISHED PH.D. DISSERTATION, COLUMBIA 
UNIVERSITY, 1964. 



Purposes ? Language functioning in deaf children differs 
tuarke'^lv from that in hearing children. One aspect of language 
in the deai Ihai: has not been studied previously is the extent 
to which its redundancy differs n-ui.. that of the language of 
the hearing. 

Redundancy in language facilitates correct reception of 
a message. In the deaf construct messages with less redun- 
dancy than is generally found in the language of their hearing 
peers, they thereby decrease the likelihood that their 
messages will be correctly received. Alternatively, the deaf 
may share verbal habits with one another that make their 
messages more predictable to each other than they are to the 
hearing. 

The present study used the cloze technique to study the 
comparative redundancy of story paraphrases written by deaf 
and hearing children and the ability of deaf and hearing groups 
to use this redundancy. 



Principles. Concepts, or Procedures : The experimental groups 
were composed of 46 profoundly deaf and 46 hearing children 
matched for reading ability. At the first of two testing 
sessions each subject read a brief story and then rewrote that 
story in his own words. Following that session, words were 
periodically deleted from each child's paraphrase and from the 
original passages. At a second session, each subject restored 
deleted words to one original passage, one deaf paraphrase, 
and one hearing paraphrase, each involving a different and un- 
familiar story. 

Ninety-two additional hearing children provided informa- 
tion about the redundancy of the original passages. On sepa- 
rate occasions, 175 hearing graduate students and 43 addition- 
al deaf children reconstructed the deleted materials. 



See also Sandra R. Cohen, "Predictability for Deaf and 
Hearing Paraphrases," Appendix. 
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Information about the redundancy of materials was suv 
?i experimental groups and 

y the additional deaf and hearing subjects. Responses were 
scored on three criteria: verbatim (identical to deleted 
word;, form class (same part of speech as deleted word), and 

Se?rJS^?o/^^!;T r ^l^^^t^ Additional analyses 

were carried out to locate the source of observed differences 
between the predictability of deaf and hearing paraphrase?! 

Conclusions : 

1) Hearing subjects found deaf stories; sicnificantlv ieQ« 
predictable than original or hearing stories!^ ^ 
predictable^ subjects found different types of material equally 

3) Hearing subjects made significantly more correct re- 
storations to hearing and original stories than did deaf sub- 
jects, but on deaf stories there was no difference between the 
groups. •* 

^) Even when the form class of a deleted word had been 
correctly identified, hearing subjects made significantly fewer 
stories ^° <=^eaf than to hearing or original 

«r.n^^5l 5?"^!^"^^®°''^? stories significantly less 

predictable than hearing stories which were, in turn, signifi- 
cantly less predictable than original stories. signiii 

r,hr.oon; ^^^^^^ ■to'tal length of the para- 

Phrases failed to differentiate between the groups. 

+n and hearing subjects had a slight tendency 

to select the more redundant words in the original story for 
use in their paraphrases of it. sxory lor 

*r>.™?l-°®f^ paraphrases contained a higher proportion of un- 
gramraatical sentences than did hearing paraphrases. 

such °^ deaf paraphrases probably resulted from 

factors as idiosyncratic usage, random errors, and deaf- 
* hypothesized that differences between deaf and 
hearing performance were due to the fact that the hearinc had 
«e«Jpr.^?'P of English than the deaf and the?lfS?e sSfwed 
greater differentiation between good and poor language samples. 

«^ vJ^^^ failure of the deaf to learn the. customary structure 
hLSS'fn.w-H^^?*^ in difficulty in receiving messages froS 
S! ^il^S. J? ""^^^"^^^ constructing messages whiSh could 

be correctly received by the hearing. The problem of communi- 



cation between deaf and hearing individuals seems especially 
serious in view of the fact that the deaf subjects in this 
study were selected for their ability to perform well on ver- 
bal tasks 



^Dissertation Abatracta (Ann Arbor, Michigan! Univer- 

^^^V' ^o^' 26, No. 8, p. ^^792. (Order No. 
65-13 »929» 127 pages). 
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COLEMAN, E. B., AND BLUMENFELD, J. P. "CLOZE SCORES OP NOMINAL- 
IZATIONS A:ID THEIR GRAT/IMATICAL TRANSFORMATIONS USING 
ACTIVE VERIS." PSYCHOLOGICAL REPORTS . I3 (I963), 651-65^f. 



Purpose t Nominalized sentences were compared for comprehensi- 
bility to their grammatical transformations using active verbs- 
John's description of it . . .•• versus "John described it." 



Principles. Concepts, or Pronpdnrpai Subjects were 100 college 
freshmen each of whom was given a set of sentences of which half 
were the active -verb version and half were the nominalized ver- 
sion. Every sentence in the total design was written in these 
two styles. For each set (nominalized and active verb), five 
cloze tests were made by deleting every fifth word. "Then there 
were 10 different cloze tests for each sentence Ss 

^S^°,i°c^?"?f.S{ ^2 each cloze test 

was filled in by 10 Ss." (652) Synonyms were not accepted. 

Conclusions t "The word patterns of the passages written in ac- 
tive verbs are more predictable than those written in nominali- 
zations." (653) 



155 



DEVITO, JOSEPH A. -COMPREHENSION FACTORS IN ORAL AND WRITTEN 
DISCOURSE OF SKILLED COMMUNICATORS." SPEECH MON OGRAPHS. 
32 (1965) t 124-128. ' 



Purpose! The purpose of the study was 

• • . to compare written and oral samples of the 
Work of skilled comiiiuni caters for (l) over-all 
comprehensibility as measured by cloze procedure 
and (2) significant differences in selected ele- 
ments, supposedly related to ease of comprehen- 
sion. (124) 

Principles, Concepts , or Procedures ! Ten university professors 
submitted written passages they considered the best examples of 
their writing styles. These were divided into three hundred- 
word segments from which three segments were drawn at random. 

Oral discourse samples were obtained by asking general 
questions based on the submitted articles, recording the oral 
responses, and transcribing the content. 

One oral and one written sample from each of the ten pro- 
fessors was drawn at random. Every fifth word was deleted. 
Subjects were 85 students ranging from sixteen to eighteen 
years of age. Each subject completed two oral and two written 
passages and all from different sources. 

Conclusions! Among the conclusions drawn by the author is! 

Oral and written discourse, according to an appli- 
cation of cloze procedure, did not differ signifi- 
cantly in each of comprehension. Since the two 
sets of samples did not differ sig-nificantly on 
■any of the specific criteria, this result is puzzl- 
ing. One possible explanation is that the cloze 
procedure is not a sensitive device when the samples 
are at a relatively advanced level and the respon- 
dents are undergraduates. (126) 
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PILLENBAUM, SAMUEL, AND JONES, LYLE V. "AN APPLICATION OF 

•CLOZE* TECHNIQUE TO THE STUDY OF APHASIC SPEECH." JOUR- 
NAL OF ABNORT.IAL AND SOCIAL PSYCHOLOGY . 65 (I962), 18>I89. 



Purpose t The speech of aphasics was studied by means of the 
cloze procedure . 



Principles. Conce pts, or Procedures ; Samples of approximately 
250 words were drawn from the free speech responses of nine 
aphasics and three normal subjects to selected cards of the 
Thematic Apperception Test . Three sets of booklets were con- 
structed, each comprising, first, a normal subject's sample 
followed by three aphasic samples. Every-f ifth-word dele- 
tions were used. 

Subjects were college summer school students who, under 
timed conditions, were required to complete at least three- 
quarters of the blanks on each page of their booklets. For 
analysis purposes, the deleted words were classified accord- 
ing to form class.. 



Conclusions » 

The aphasic speech samples typically were less ac- 
curately completed than normal control samples, . . .j 
and given that the form class of an item had been 
correctly identified raters were still less likely to 
hit upon the exact missing word for the aphasic texts 
than for the normal control texts. (I89) 

In general the cloze procedure was found to provide an in- 
dex of divergence from normal of a speaker's language. 
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GOODSTEIN, HENRY ARTHUR. "THE PERFORMANCE OF EDUCABLE MENTAL- 
LY HANDICAPPED AND AVERAGE-IQ CHILDREN ON TWO MODIFIED 
CLOZE TASKS FOR ORAL LANGUAGE." UNPUBLISHED PH.D. DIS- 
SERTATION, THE UNIVERSITY OF CONNECTICUT, I969. 



Purpose : It was hypothesized that: (a) ET/IH children are sig- 
nificantly poorer than average-IQ children in cloze performance 1 
(b) the recognition cloze task would be significantly easier 
than the production cloze taskj and (c) a significant interac- 
tion exists between IQ and task, with recognition exceeding 
production for the low-IQ sample to a greater extent than re- 
cognition exceeds production for the average-IQ children. 



Principles. Concep ts^ or Procedures ; A sample of public school 
educable mentally handicapped and a sample of average-IQ chil- 
dren were matched for mental age (approximately 9 years-5 months) 
and reading age (approximately 8 years-6 months). The samples 
were administered two modifications of cloze procedure that re- 
flect the two important processes in oral language, production 
and recognition. The production task requires the child to 
complete appropriately a four-word sentence, in which one word 
has been randomly deleted. The recognition task differs in 
that it requires the child to choose the appropriate response 
from among four words to complete the sentence. 



Cgnplusions t The null forms of the first two hypotheses were 
rejected (p < .01). The hypothesized interaction was not sig- 
nificant (p > .01). No qualitative differences were found in 
the performance of the two samples. 

The results were interpreted as reflecting inefficiencies 
in the organization and retrieval of linguistic stimuli by low- 
IQ children. Implications for potential language training 
programs utilizing cloze procedure were discussed. ^ 



Dissertation Abstracts International At The Humanities 
and Social Sciences (Ann Arhnr. Mirh^grgw. University Micro- 
films, 1970), Vol. 30, No. 8, p. 3320-A. (Order No. 7O-I263, 
53 pages). 
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HONIGFELD, GILBERT. "EPFECT OF AN HALLUCINOGENIC AGENT ON VER- 
BAL BEHAVIOR." PSYCHOLOGICAL REPORTS . I3 (I963) , 383-385. 



Purpose : "This report is a first attempt to apply Cloze analy- 
sis to the study of the effect of drugs on 'understandabilitv. •" 
(383) 

Principles. Concept s, or Procedures ! A drug was administered 
to a 22 year old medical student whose spontaneous speech 
samples were mutilated with every-fif th-word deletions when 
transcripts were made. Twenty-two subjects enrolled in an 
evening psychology class were required to restore the deleted 
words. 



Conclusions: 

. . . our S»s speech appears to be somewhat less 
understandable than a Life magazine article, but 
more easily understood than excerpts from the works 
of Francis Bacon or Benjamin Franklin. (384-385). 

The author concludes that the cloze procedure is useful in 
evaluating drug effects. 
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HONIGPELD, GILBERT. "THE ABILITY OP SCHIZOPHRENICS TO UNDER- 
STAND NORMAL, PSYCHOTIC, AND PSEUDO-PSYCHOTIC SPEECH." 
DISEASES OF THE NERVOUS SYSTEM . 2^^ (I963), 692-69^. 



Purpose t The h:/pothesis that the speech of schizophrenics is 
more easily understood by other schizophrenics than other in- 
dividuals was tested. 



Principl es, Concepts, or Procedures 1 By means of the cloze 
procedure, the understandability of six passages was deter- 
mined by a group of 32 college students. Three passages of 
equal understandability were selected! a newspaper excerpt, 
an excerpt from an interview with a schizophrenic, and a 
spont. -ecus speech excerpt from a normal volunteer under the 
influence of an hallucinatory drug. These passages were then 
administered to sixty schizophrenic patients. 



Conclusions t **. . , no evidence was found to support the 
clinical hunch that schizophrenics find it relatively easier 
to understand the speech of other schizophrenics." (693) 



160 



HONIGFELD, GILBERT j PLATZ, ARTHUR; AND GILLIS, RODERIC D. 
"VERBAL STYLE AND PERSONALITY t AUTHORITARIANISM." 
JOURNAL OF COtMUNI CATION . l4 (1964), 215-218. 



PurpoBe I This study sought to determine if the cautious 
approach of authoritarian persons finding themselves in novel 
problem situations would manifest itself in the style adopted 
by subjects in response to a cloze test. 



Principles. Concepts, or Procedures t After authoritarianism 
scores were obtained for each of the 2? evening college stu- 
dents who were subjects, a series of six cloze tests was ad- 
ministered. Every-fifth-word deletions were used. The number 
of uncompleted items was computed as an estimate of cautious- 
ness of style. 



Conclusions t Subjects rated as highly authoritarian left a 
significantly greater number of blanks than did those receiv- 
ing a low rating. 
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LOUTHAN, VINCENT. "SOME SYSTEMATIC GRAMMATICAL DELETIONS AND 

THEIR EFFECTS ON READING COMPREHENSION • " ENGLISH JOURNAL . 

5^ (1965) t 295-299 • 



Purpose : This study was undertaken to determine the effects of 
deleting certain grammatical classes of words. 



PrincipleSf Concepts, or Procedures 1 Twenty-four prose passages 
of 500 to 600 words were graded at a 5*0 readability index 
according to the Yoakam formula. Seven cloze forms were pre- 
paredt utilizing ten percent deletions according to seven gram- 
matical classes. An eighth form was left intact as a control • 
All forms were followed by twelve comprehension questions: 
six factual and six inferential. 

Each of the 236 seventh-grade subjects were assigned a 
cloze form at random and completed six exercises in it. The ex- 
periment lasted three weeks. 



Conclusions t Among the findings are the following: 

1. The control group was significantly superior in some in 
stances to groups using cloze materials. 

2. Noun deletions, specific verb deletions, and modifier 
deletions caused a marked loss in comprehension. 

3. Deletions of prepositions, conjunctions, and pronoun 
substantives do not cause a loss of comprehension. 

4. The deletion of noun determiners produced a significant 
gain in comprehension. 
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MANIS, MELVIN, AND DAWES, ROBYN M. "CLOZE SCORES AS A FUNCTION 
OP ATTITUDE." PSYCHOLOGICAL REPORTS . 9 (I96I), 79-84, 



Purpose t The authors 

1# tested the assumption that 

• • • recipients, who disagree with the contents of 
a controversial statement, will be relatively in- 
sensitive to the redundancy of the communicator's 
words. (79) 

2, investigated the likelihood that a subject's views 
would influence his responses in situations where ambiguity 
was increased by the omission of context clues. 



Princi ples. Conce'Pts. or Procedures t 

Two 400-word passages, one favoring capital punish- 
ment and one opposing it, were chosen, , , , For 
the "high-deletion" group (N « 41) every fourth 
word was removed* for the "low-deletion" group 
(N « 31) every eighth word was removed, (80) 

Subjects were college students who, before replacing the 
missing words, rated a phrase concerning capital punishment 
on six scales of the semantic differential. 



Concluslonfl i 

1. Subjects showed a general tendency to perform more 
effectively on the passage that echoed their own views, 

2. Connective deletions— verb auxiliaries, conjunctions, 
pronouns, and articles—were more highly related to attitude 
Than were content deletions — nouns, verbs, adverbs, 

3» • • these data support the proposition that 
cognitive performance may be adversely affected 
when the individual is presented with materials 
that contradict his beliefs, (84) 
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MARSHALL, WILLIAM JAMES ALOYSIUS. "INVESTIGATING THE EFFECT 
■ OF CONTEXTUAL CONSTRAINT ON DEAF AND HEARING CHILDREN AT 
THE FOURTH GRADE READING LEVEL, USING THE CLOZE PROCE- 
DURE." UNPUBLISHED ED.D. DISSERTATION, UNIVERSITY OF 
ILLINOIS AT URBANA-CHAMPAIGN, 1970.1 



Purpose t An area of research interest having received minimal 
attention in the past is the manner in which redundancy affects 
the deaf child's perception of the syntactic and semantic cues 
of written language. 

Using cloze procedure to investigate linguistic compe- 
tence, the study examined how, through manipulation of the 
overall language structure, a deaf child's psychological and 
linguistic perception of contextual cues affected his ability 
to make correct predictions on stimulus materials that had 
been selectively mutilated with respect to their contained 
grammatical construction. 



Princip les. Concepts, or Procedures : The experimental group 
consisted of 9 male and 15 female residential school deaf 
children with a mean grade reading score of ^.^ and ^,5, re- 
spectively on the. Stanford Achievement Test . Their mean per- 
formance IQ's on the non-verbal Wechsler Intelligence tests 
were 107.7 and 100.8 for the males and females, with the mean 
age being 16 years, 1 month and 16 years, 5 months, respective- 
ly. The comparison group of 9 male and 15 female fourth and 
fifth grade hearing students had a mean grade reading achieve- 
ment score of ^.3 and ^.4 respectively. Their mean IQ's on 
the non-verbal California Short-Form Test of Mental Maturity 
were 111.7 and IO3.6 for the males and females with the mean 
age being 9 years, 6 months and 9 years, 5 months, respectively. 

One 809 word passage was chosen as the stimulus material 
from a graded reading text with a reported difficulty level of 
3.6 according to the Spache Readability Formula . This passage 
was then subjected to a total of 50 deletions occurring within 
grammatical constructions specifically identifiable by the sur- 
rounding content. This passage thus manipulated comprised the 
first of three levels of contextual constraint, namely, the 
connected discourse level. 



■^See also William A. Marshall, "Investigating the Effect 
at Fourth Grade Reading level Using the Cloze Procedure," 
Appendix. 
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While maintaining the same deletions, the discrete sen- 
tence level of contextual constraint was formed. These sen- 
tences were presented in a randomized order so as to preclude 
the possibility of any connected ideas being gleaned from them. 
Lastly, with these same deleted items still being used, the 
fragment level of contextual constraint was constructed with 
only a minimal number of contextual cues being retained so as 
not to destroy the earmarks of any given grammatical construc- 
tion. 

The criterion scores used for estimating the grammatical 
competence of both groups of subjects were the Close scores of 
correct Verbatim , correct Form Class and correct Verbatim given 
Form Class response. The statistical design used to analyze 
each of these scores was a factorial 3x2x2 (Contextual Con- 
straint by Sex by Physical Status of Hearing) analysis of vari- 
ance. V/hen a significant F occurred for the variable of Con- 
textual Constraint, the a posteriori "Tukey (a) Procedure" 
test of multiple comparisons was also used. 



Conclusions; Three hypotheses were tested in the investigation. 

Contextual. Constraint . The hypothesis of no differences 
among the connected discourse, discrete sentence and fragment 
levels of contextual constraint was rejected at the one per 
cent level for the Verbatim and Form Class cloze criterion 
scores only. Although there were differences among the Ver - 
batim gi ven Form Class means, these differences were small 
enough to be attributable to chance. 

In testing further for differences between pairs of means 
among the three levels of contextual constraint with the 
"Tukey (a) Procedure," significant differences were found only 
between the higher scores of the connected discourse level and 
the lower scores at the fragment level for both the Verbat im 
and Form Class responses. Differences of a similar nature 
were found for the Verbatim given Form Class responses, but 
these did not reach significance. 

Sex. The tenability of this exploratory hypothesis of no 
differences had to be accepted for all of the criterion scores 
on all levels of contextual constraint and for all subjects. 

Physical Status of Hearing . The hypothesis of no differ- 
ences between the mean criterion scores of the experimental 
and comparison groups across all levels of context and sex was 
rejected for the Verbatim and Forms Class scores only. It was 
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again found, however, that the Verbatim given Form Class 
scores failed to produce significant differences. 

The results indicated that the relative redundancy of the 
grammatical and semantic cues of the stimulus materials greatly 
affected those areas of grammatical competence as assessed by 
the cloze scores of Verbatim and Form Class responses. It is 
quite difficult, however, to find a convincing interpretation 
for the negative ph^^nomenon produced by the Verbatim given Form 
Class scores. One possible explanation was that the Verbatim 
completions did not improve at any arithmetical rate propor- 
tionately faster than the Form Class completions. Another ex- 
planation was suggested by intimating the presence of a con- 
founding factor such as the relative redundancy of both the 
syntactic and semantic cues inherent in the stimulus materials. 
Further controlled experimentation is needed to test for the 
effect of the relative redundancy of syntactic and semantic 
cues within various levels of contextual constraint.! 



Dissertation Abstracts International A» The Humanities 
and Social Sciences (Ann Arbor. Michigan; University Micro- 
films, 1970), Vol. 31 f No. 5t p. 2218-A. (Order No. 70-21,01^, 
104 pages). 
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MOORES, DONALD FREDERICK. "APPLICATIONS OF 'CLOZE* PROCEDURES 
TO THE ASSESSMENT OF PSYCHOLINGUISTIC ABILITIES OF THE 
DEAF." UNPUBLISHED PH.D. DISSERTATION, UNIVERSITY OF 
ILLINOIS, 1967, 



Purpose : Traditional methods employed in the measurement of 
grammatical and semantic abilities of the deaf, typically 
analysis of written language samples and the use of reading 
scores on standardized achievement tests, have been shovm to 
suffer from fundamental inadequacies. The study was designed 
to investigate the ability of "cloze" procedures to identify 
and isolate morphological syntactic, and semantic differences 
between a deaf gro'.p and a hearing grout) matched on the basis 
of reading scores on a standardized achievement test. Based 
on the contention that standardized tests provide spuriously 
inflated estimates of the grammatical and semantic abilities 
of the deaf, it was hypothesized hat hearing students, 
matched to deaf subjects on the basis of reading scores, actu- 
ally possess superior psycholinguistic abilities in all areas 
and that their superiority would be exhibited through various 
applications of "cloze" techniques. 



Principles. Concent s, or Procedu res » The experimental group 
consisted of 37 residential school deaf children with a mean 
grade reading score of ^.77 on the Stanford Achie vement Tes-h 
and an average age of 16 years nine months. The control group, 
37 fourth and fifth grade hearing students, had a mean grade 
reading achievement score of 4.85 and an average age of nine 
years, 10 months. A contrast group of 24 high school hearing 
students was used for purposes of comoarison but their scores 
were not used in the statistical analyses. 

Passages of 250 words were chosen from a fourth, sixth, 
and eighth grade reading book. Every fifth word was deleted 
and subjects were instructed to fill in the most appropriate 
words. Responses were scored for (a) verbatim reproduction, 
lb; fore, class (grammatical) reproduction, and (c) verbatim 
given form class reproduction — the percentage of correct ver- 
batim responses given correct form class reproduction. 

Cpnclusions : Verbatim . The performance of the control erouv 
was superior (p. < .001) and the superiority existed for each 
passage, supporting the argument that standardized reading 
scores over-estimate psycholinguistic abilities of the deaf. 
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Form Class , The scores of the control group were superior 
on this measure (p. < .01) and the superiority existed for all 
passages but did not reach significance for the eighth grade 
test (.10 > p. > .05). The results suggest that at least part 
of the inferiority of the deaf may be explained in terms of 
inadequately developed morphologico-syntactic integrations. 

Verbatim Given Form Class . The scores of the control 
group on this measure were significantly higher (p. < .001) 
and the superiority existed for each passage. It is concluded 
that in addition to the poorly developed grammatical abilities 
identified in the form class measure t the deaf are further 
handicapped by semantic insufficiencies in the form of redun- 
dantt stereotyped modes of expression and limited vocabulary. 

The results indicate that "cloze" procedures possess a 
sensitivity to morphological, syntactic, and semantic abilities 
which standardized tests are incapable of measuring. Further 
uses of "cloze" procedures could identify patterns of psycho- 
lingidstic strengths and weaknesses and have implications for 
revisions in the teaching of language to the deaf. The use of 
"close" procedures to develop individual assessment techniques 
is also suggested. The technique could supplement or replace 
present methods of language measurement, which are classifica- 
tory in nature, and provide the basis for educational diagnosis 
leading to an individually proscribed program of remediation. 1 



i 

I 
I 
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^Dissertatio n Abstracts At The Humanities and Social 
Sciences (Ann Arbor. Michigan t University Microfilms, 1968), 
Vol. 28, No. 8, p. 3032-A. (Order No. 66-I8I3, M pages). 
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RAMANAUS.CASt SIGITA ONA. -THE EFFECT OF CONTEXTUAL CONSTRAINTS 
BEYOND A SENTENCE ON CLOZE RESPONSES OF CHILDREN IN 
SPECIAL CLASSES FOR THE EDUCABLE MENTALLY RETARDED." 
UNPUBLISHED PH.D. DISSERTATION, THE UNIVERSITY OF CONNEC- 
TICUT, 1971 • 



Purpose : The author does not state a purpose. 



Principles, ConceptSt or Procedures ; Subjects were 58 educable 
mentally retarded pupils reading at a grade level equivalent of 
2.5 or above on the Wide Range Achievement Test and attending 
junior high special classes in suburban towns. They were admin- 
istered two cloze tasks constructed from basal reader selections 
at the 2-2 level. One task consisted of selections containing 
sentences in the natural order of discourse (NAT). The other 
task^ involved materials wherein .sentence order was modified by 
being randomly rearranged (MOD). The two conditions differed in 
availability of contextual cues beyond a sentence. A Latin 
Square design was used with repeated measures over type of ma- 
terial (NAT and MOD) and order effect controlled through coun- 
terbalsmcing. 



Conclusions t An analysis of variance confirmed (p < .OOO5) the 
expectation that significantly more correct cloze responses 
would be produced in the NAT condition. Order of treatment pre- 
sentation was not significant but a significant (p < .02) ordinal 
interaction was observed between type of material and order. 
More correct cloze responses were produced when NAT was pre- 
sented second but the relative effect of NAT and MOD was undis- 
turbed. It was concluded that mentally retarded pupils having 
the characteristics of the subjects of this study are not word 
callers or even sentence specific readers at least as measured 
by the cloze technique using basal series materials. They are 
responsive to contextual constraints beyond the sentence. Pos- 
sibilities, for future study and educational implications were 
discussed*'^ 



I 

ERIC 



^ Dissertation Abstracts International At The Humanities 
and Social Sciences (Ann Arbor* Michigan » University Micro- 
films, 1971 ). Vol. 32. No. 5» p. 2515-A. (Order No. 71- 
29f900, 80 pages). 
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RANKIN, EARL P., JR. -READING TEST RELIABILITY AND VALIDITY AS 
FUNCTION OF INTROVERSION-EXTROVERSION." JOURNAL OF DEVEL - 
OPMENTAL READING . 6 (1963) f 106-117. 



Purpose t The author conducted a series of three studies to 
determine the relationship between introversion-extroversion 
and reading test reliability and validity. 



Principles. Concepts, or Procedures 1 Reading comprehension 
and introversion-extroversion measures were computed for each 
of the 161 college students participating. Some subjects took 
a pre-reading cloze test while others took a post-reading 
cloze test. One article was used in the study. 



Conclusions t The fact that pre-cloze tests demand more per- 
sistence and greater organizational skill than post-cloze tests 
may account for the fact that extroverts performed less well 
than introverts on the pre-cloze test. Post-cloze scores did 
not differ significantly. 

The overall conclusion of the three studies was that a 
relationship exists between introversion-extroversion and read- 
ing test reliability and validity. 
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SBMMEL, MELVYN I.| BABBITT, LOREN S.| AND BENNETT, STANLEY W. 
"PERFORMANCE OP EMR AND NONRETARDED CHILDREN ON A MODI- 
PIED CLOZE TASK." AMERICAN JOURNAL OF MENTAL DEF ICIENCY 
7^ (1970), 681-688. ' ~ 



Purpose : The authors report a study designed to investigate 
the grammatical ability of educable mentally retarded children. 



Principles, Concepts, or Procedures t Two groups of EMR chil- 
dren attending an institution and a public school were matched 
with two groups of non-retarded children on the basis of in- 
telligence and chronological age. 

Forty-four word sentences, utilizing different word orders, 
were placed on individual cards. One word was omitted from 
each sentence. A subject was required to replace it orally 
while the sentence was read by an experimenter and the subject 
read the card. 



Conclusions* EMR children did, in fact, have difficulty with 
the cloze tasks due probably to weak grammatical decoding 
structures. The results indicated, however, that language 
development may be more closely related to chronological age 
than to mental development. 
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WEAVER, WENDELL WILLIAM. "AN EXAMINATION OF SOME DIFFERENCES 
IN ORAL AND WRITTEN LANGUAGE USING THE CLOZE PROCEDURE." 
UNPUBLISHED ED.D. DISSERTATION, UNIVERSITY OF GEORGIA, 
1961. 



Purpose ; The problem of this study was to determine if differ- 
ences existed in the ability of subjects to predict words omitted 
from language materials intended for oral and written presenta- 
tion. Tests designed in this fashion have been named "cloze" 
tests. 



Principles. Conce pts, or Procedures ? Two groups of 80 subjects 
each (Juniors and Seniors at the University of Georgia) were 
used in this study. The subjects were further sectioned into 16 
groups of 10 each and administered 8 "cloze" tests in various 
orders. The last test given in each instance was the experimen- 
tal test. The "cloze" tests used were constructed by deleting 
every tenth word from language passages intended for oral and 
written presentations, and by deleting every tenth noun or main 
verb in other language passages intended for oral and written 
presentation. 

One group received "cloze" reading tests and cloze aural 
tests in a multiple-pass situation. That is, they were allowed 
as many repetitions of the listening materials as they desired. 
The other group received "cloze" reading tests and "cloze" aural 
tests in a single-pass situation. They were allowed to hear the 
aural materials only once. 

A2X2X^ analysis of variance design was used for the 
statistical analysis of the data. The multiple-pass and the 
single-pass situations were analyzed separately. 



Cfinclusionsj Although the multiple-pass aural situation in- 
creased the predictability of the missing words, the relation- 
ships within the two situations were essentially the same. The 
central, finding is that structural meaning, as shown by the pre- 
dictability of "any-word" cloze, is conveyed significantly 
better by silent reading while lexical meaning, as shown by the 
predictability of nouns and main verbs, is conveyert equally well 
by listening or by silent reading. Whatever advpiitage allowed 
the greater predictability of structural meaning in the silent 
reading situation is in some maimer lost in the listening situa- 
tion. 
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There are indications that this loss :j due to the rela- 
tively small context necessary for supplyixig predictive infor- 
mation in the lexical case in most situations, compared to the 
relatively larger context needed to supply all the structural 
meaning available. The fact that larg'e contextual elements 
can be analyzed only with great difficulty in the listening 
situation may drive the organism to use the strategy of depend- 
ing on the small context in both structural and lexical situa- 
tions, thereby losing the structural meaning which depends 
upon large context. 



ptsaertation Abstracts (Ann Arbor, Michigan! University 
Microfilms, 1962), Vol. 22, No. 8, p. 2702* (Order No. 61- 
6587, 1^7 pages). 
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WEAVER, WENDELL W., AND BICKLEY, A. C. •'SOME DIPPERENCES IN 
ENCODING AND DECODING MESSAGES." JOURNAL OP THE READING 
SPECIALIST . 7 (1967). 18-25 . 



Purpose t 

The purpose of this study is to determine the abil- 
ity of subjects, to predict the omissions from a 
natural language text which they had previously 
produced themselves as contrasted with the ability 
of other subjects to predict omissions from these 
same texts which they had read at the time of pro- 
duction. (18) 



Principles. Concepts, or Procedures : Subjects were 64 random- 
ly selected college sophor.»ores who ware randomly assigned to 
one of two experimental and two control groups. One experi- 
mental group produced written stories in response to two 
Thematic Apperception Test cards and the second group read 
the stories. Two days later both groups were administered 
cloze tests which Utilized every-seventh-word deletions. One 
control group also produced stories but did not refer to them 
again. Subjects read stories written. by the experimental 
group and were administered a cloze test two days later. The 
second control group was given stories to read followed two 
days later by cloze tests produced by the experimental group's 
stories which had not before been seen. 



Conclusions i Predictability of missing elements in passages* 
is increased when subjects are sources of the messages as 
well as destinations. 



WEAVER, WENDELL W., AND KINGSTON, At^BERT J. "A FACTOR ANALYSIS 
OF THE CLOZE PROCEDURE AND OTHER MEASURES OF READING AND 
LANGUAGE ABILITY." JOURNAL OF COMMUNICATION , 13 (I963)f 
252^261. 



Purpose ! "This study explores a number of measures of language 
ability and attempts to isolate a set of fundamental components." 
(252) 



Principles, ConceptSt or Procedures : A battery of eighteen 
tests was administered to 160 college juniors. The battery com- 
prised t 

1. The Davis Reading Test . 

2. The MLAT Number Learning Subtest . 

3. The MLAT Phonetic Scrir>t Subtest . 

4. The MLAT Spelling Clues Subtest . 

5« The MLAT V/ords in Sentences Subtest . 
6. The MLAT Paired Associates Subtest . 
?• STEP Listening Test . 

8. The Ohio State Psychological Examination-Vocabulary . 

9» The Ohio State Psychological Examination^Word Relations > 

10. The Ohio btate Psychological Examination-Reading Com - 
prehension . 

11. Cloze I A Structural Deletion of Essay Material (Sub- 
ject reads) . 

12. Cloze II - A Lexical Deletion of Essay Material (Sub- 
ject reads) . 

• 13* Cloze III - A Structural Deletion of a Speech (Subject 
reads) . 

1^. Cloze IV - A Lexical Deletion of a Speech . (Subject 
reads). \ 

15- Cloze V - A Structural Deletion of Essay Materi al (Sub- 
ject listens) . 

16. Clo7o VI - A Lexical Deletion of Essay Material (Sub- 
ject listens^). 

17. Cloze VII - A Structural Deletion of a Speech (Subject 
listens) . 

18. Cloze VIII - A Lexical Deletion of a Speech (Subject 
listens) . \ 

Each cloze test contained kO deletions and had a 30 minute 
time limits Exact word replacements were required. 
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Conclusions t Among the conclusions drawn from the analysis was 

• • • that cloze tests of varied kinds are more re- 
lated to each other than to the other two factors 
isolated by this analysist verbal comprehension and 
••rote memory, flexible retrieval." It is also im- 
portant to note that there is much specific variance 
connected with the cloze procedure which is unex- 
plained by this analysis, (261) 
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WILLIAMS, FREDERICK DOWELL. "AN EXPERIMENTAL APPLICATION OF 
THE SEIvlANTIC DIFFERENTIAL AND 'CLOZE' PROCEDURE AS MEA- 
SUREMENT TECHNIQUES IN LISTENING COMPREHENSION," UNPUB- 
LISHED PH.D. DISSERTATION, UNIVERSITY OF SOUTHERN CALI- 
FORNIA, 1962. 



Purpose » The purpose of this study was to appr.y two communica- 
tion research techniques — the semantic differential and cloze 
procedure — to research in listening comprehension. The semantic 
differential, a scaling technique, was used as an operational 
measurement of attitude-toward-topic and as an exploratory mea- 
surement of receptivity • Cloze procedure, used as a comprehen- 
sion measurement, is a technique whereby respondents attempt to 
replace words that have "been systematically deleted from a lan- 
guage sample. All previous reported research with cloze proce- 
dure involved its application to written materials. In this 
study a technique was devised for applying cloze procedure to 
tape-recorded oral materials. 



Principles, Concepts> or Procedures ; The problem included (1) 
investigating relationships among variables in comprehension of 
two language Selections, (2) comparing two comprehension cri- 
teria on the basis of a matched group design, (3) seeking addi- 
tional relationships between attitude measurements and antici- 
pated effects of the persuasive selection, and (4) comparing 
subjects' evaluations of the two comprehension criteria. 

Subjects were used in a two-group (N = 126 and 12?).^ 
Group I used a multiple-choice test as a comprehension cri- 
terion, whereas Group II used cloze procedure. Both groups 
heard tape-recordings of two selections taken from the Sequen - 
tial Tests of Educational Progress (listening). Selection A 
was a persuasive speech on the value of fear. Selection B 
was an expository lecture on word meanings. Relative to the 
selections, seven measurements were obtained from subjects in 
each group! pre-exposure and postexposure (selection A) 
attitude toward "fear," receptivity ar/d comprehension of se- 
lection A, receptivity and comprehension of selection B, and 
evaluation of the over-all test materials. Language ability 
scores ( American College Testing Program ) were obtained for 
105 subjects in each group. 

Relationships among the foregoing measurements were 
analyzed by use of the Pearson product-moment statistic. Co- 
efficients were interpreted on the basis of minimum signifi- 
cant r U05 level). 
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Conclusions . In listening to the persuasive selection, 
shift of attitude (difference between pre-exposure and post- 
exposure) measurements for both groups were substantially re- 
lated to favorability of postexposure attitude. There was 
also a low correlation between pre- and post-exposure favor- 
ability of attitude measurements. Receptivity measurements 
showed a definite but small relationship with both postexpo- 
sure attitude and shift of attitude. Both comprehension cri- 
teria were substantially related to subjects* ACT scores. 
But in neither group was the comprehension criterion related 
to attitude nor receptivity measurements. 

In listening to the expository selection both groups* 
comprehension measurements were slightly correlated with re- 
ceptivity measurements. Both comprehension measurements were 
substantially related to subjects*- ACT scores. 

There was a definite but small relationship between sub- 
jects* (Group I) scores on the two multiple-choice tests. 
Subjects* (Group II) cloze scores on the two selections were 
highly correlated. 

In a matched group design (53 pairs on the bases of sex, 
ACT score, age, class year), the correlation coefficient be- 
tween multiple-choice test scores and cloze scores on the per- 
suasive selection was insignificant. On the expository selec- 
tion the comprehension criteria showed a marked relationship. 

Additional relationships between semantic differential 
measurements and anticipated effects of the persuasive selec- 
tion included (1) that both grouped showed a significant shift 
in a favorable direction in over-all attitude measurements 
( sign test) and (2) that both groups* shifts on individual 
attitude scales were highly related (Spearman rho). 

In evaluating the test materials. Group I rated the mul- 
tijple-choice test as significantly (median test) more favor- 
able on bad-good and hard-easy scales than Group II had rated 
Cloze. procedure. There was no significant difference on 
slow-fast , worthless-^worthwhile a and passive-active scales. 
Neither group rated the test materials in an unfavorable 
direction on any, of the scales .1 



ssertation Abstracts (Ann Arbor, Michigan t Univer- 
sity Microfilms, I963) Vol. 23, No. 7, pp. 2628-2629. (Or- 
der No. 62-61. 9I, 219 pages). 
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CHAPTER V 



THE CLOZE PROCEDURE AS AN 
INSTRUCTIONAL TECHNIQUE 

The cloze procedure has been variously applied in 

the area of educational methodology. 

Several studies have investigated the efficacy of 

using the technique to determine reading levels, Alexander" 
2 

and Guszak assessed the independent, instruction, and 

frustration reading levels of intermediate grade pupils. 
3 

Kirby c; Tipared cloze test scores with oral and 
silent reading scores to determine whether cloze results 
are accurate determinants of the instructional reading xevel 
of elemeiitary school children. 



^Henry William Alexander, "An Investigation of the 
Cloze Procedure as a Measuring Device Designed to Identify 
the Independent, Instruction, and Frustration Reading 
Levels of Pupils in the Intermediate Grades" (an unpublished 
Ed.D. dissertation. University of Illinois, 1968). 

2 

Frank J. Guszak, A Comparative Study of the Valid - 
ity of the Cloze Test and Metropolitan Achievement Test 
IHeading Comprehen sion Subtest) for Making Judgments of In - 
structio nal Levels (Austin. Tpvagt University of Texas, 
19o9. 

3 

-'Clara Lbu Laughlin Kirby, "A Comparison of Scores 
Obtained on Standardized Oral and Silent Reading Tests and 
a Cloze Test" (unpublished Ed.D. dissertation. Ball State 
University, 196?) . 
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The validity of using cloze test results as deter- 
minants of the reading levels of first grade children who 

had been taught beginning reading by four different 

1 2 

approaches was investigated by Kirchhoff , while Sauer in- 
vestigated the hypothesis that the cloze technique is a 
valid determinant of the instructional reading level of 

disabled fourth grade readers. 

3 

Wiechelman compared the functional reading levels 
identified by cloze tests and by informal reading inven- 
tories using eighth grade students as subjects. Ransom^ 
also compared cloze test scores and informal reading in- 
ventory scores but studied elementary school children. 

^Leo Henry Kirchhoff, "A Study Utilizing the Cloze 
Test Procedure to Determine Reading levels of First Grade 
Children Who Have Been Taught Beginning Reading by Four 
Different Approaches" (unpublished Ed.D. dissertation. 
University of Kansas, 1968). 

2 

Freda Mae Saue: , "The Determination of Reading 
Instructional Level of Disabled Fourth Grade Readers Util- 
izing Cloze Testing Procedure" (unpublished Ed.D. disser- 
tation, Oklahoma State University, I969). 

•^Duane Sylvester Wiechelman, "A Comparison of 
Cloae Procedure Scores and Informal Reading Inventory Re- 
sults for Estimating Functional Reading Levels for Students 
at Eighth Grade Level" (unpublished Ed.D. dissertation. 
University of Northern Colorado, 1971). 

Peggy Elaine Hitchcock Ransom, "A Study to Deter- 
mine Reading Levels of Elementary School Children by Cloze 
Testing" (unpublished Ed.D. dissertation. Ball State Uni- 
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Schoelles^ investigated the cloze procedure as a 
predictor of r'^ading group placement. 

Criterion levels of performance for instructional 

2 3 

tasks were developed by Bormuth, and Rankin assessed the 
grade level interpretation of cloze scores. 

Several studies have investigated the use of the 
cloze procedure as a teaching device. Bloomer employed 
the cloze procedure as a remedial reading technique for 
college students. Bloomer^ also studied the effects of 
non-overt reinforcement of cloze responses of students at 
selected grade levels. 



Iris Storey Schoelles, "Cloze as a Predictor of 
Reading Group Placement" (paper presented at the Annual 
Meeting of the International Reading Association, Atlantic 
City, New Jersey, April 19-23, 1971). 

Bomwth, Development of Standards of Readability ; 
Toward a Rational Criterion of Passage Performances . Final 
Report to the Office of Education, Department of Health, 
Education, and Welfare, Project No. 9-0237 (Chicago » Uni- 
versity of Chicago, June 1971). 

^Rankin, "Grade Level Interpretation of Cloze 
Readability Scores" (paper presented at the National Read- 
ing Conference, St. Petersburg, Florida, Decesiber 3-5, 1970. 

^, 

Richard H. Bloomer, "The Cloze Procedure as a 
Remedial Readling Exercise," Journal of Develop mental Read- 
ing. 5 (1962). 173-181. " 

< 

•^Bloomer, "The Effects cT Non-Overt Reinforced 
Cloze Procedure Upon Reading Comprehension," New Frontiers 
in College-AdlMlt Reading, ed. by G. B. Schick and M. M. 
May, Yearbook of the National Reading Conference (Milwau- 
kee, Wisconaint National Reading Conference, 1965, pp. 
31-*^0• 
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After determining the krowledge of grammatical 
usage of achieving students of English which enabled them 
to learn material more efficiently than non-achieving stu- 
dents, Blumenfeld and Miller provided instruction to the 

latter students by means of the cloze procedure. 

2 

Guice, Hunter, Smith, and Stewart utilized the 
cloze procedure as an instructional device to improve the 
reading comprehension of college students, while Friedman 
studied its effect on the reading comprehension of foreign 
college students. 

The differential effects of instruction in trans- 

^ Jacob P. Blumenfeld and Gerald R. Miller, "Improv- 
ing Reading Through Teaching Grammatical Constraints," 
Elementary English . 43 (1966), 752-755. 

^illy Milton Guice, "An Experiment Combining In- 
struction in Comprehension With Practice in the Cloze Pro- 
cedure m Reading" (unpublished Ed.D. dissertation. Uni- 
versity of Southern Mississippi, 1966)? Charles F. Hunter. 

Clozmg the Gap: An Approach to Solving Reading Proilems 
^5 i^r°^^ ^^^^ College" (paper presented at the meeting 
of the Western College Reading Association, Los Angeles, 
California, April I.3, 1971)» Elmer L. Smith, "Use of the 
Cloze Procedure in Improving Comprehension of Junior College 
Readers (paper presented at the National Reading Confer- 
ence, Atlanta, Georgia, December 4-6, 1969)1 Elneita Wallace 
Stewart, A Comparative Study of the Effectiveness of Cloze 
and Textbook Procedures in a College Reading Program" (un- 
published Ed.D. dissertation. University of Houston, I967). 

%ldred McElhinney Friedman, "The Use of the Cloze 
Procedure for Improving the Reading Comprehension of 
Foreign Students at the University of Florida" (unpublished 
Ed.D. dissertation. The University of Florida, 196^). 
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fonnational grammar and the completion of cloze exercises 

on the reading, writing, and listening of college freshmen 

were investigated by Martin.^ 
2 

Guscott presented exercises in the form of over- 
head transparencies to sixth grade students and assessed the 

3 

effects on reading achievement, and Paubion measured the 
effect of the cloze procedure on the comprehension of fourth 
grade students. Hafner and Rankin and Overholser applied 
the cloze procedure to teaching context aid3 to intermediate 
grade children. The effects of cloze exercises on the 

"^Ruby Wheeler Martin, "Transformational Grammar, 
Cloze, and Performance in College Freshmen" (unpublished 
Ed.D. dissertation, Syracuse University, I968).-: " 

2 

Charles Edgar Guscott, "The Effect of Cloze Proce- 
dure Exercises on the Improvement of Reading Achievement 
and of Reading Comprehension of Selected Sixth-Grade Stu- 
dents" (unpublished Ph.D. dissertation. The University of 
Akron, 1971). 

3 

Norma Nell Paubion, "The Effect of Training in the 
Use of Cloze on the Ability of Fourth Grade Pupils to Gain 
Information Prom V/ritten Discourse" (unpublished Ph.D. dis- 
sertation, Texas AMA University, I97I). 
if 

4.U r.** ^*^ence Erhardt Hafner, -'An Experimental Study of 
the Effect on Various Reading Achievement Scores of Teach- 
ing Selected Context Aids to a Group of Fifth Grade Pupils" 
I^P^^lished Ed.D. dissertation. University of Missouri, 

^Earl P. Rankin and Betsy M. Overholser, "Reaction 
of Intermediate Grade Children to Contextual Clues." Jour- 
nal of Reading . 1 (1969), 50-73, 
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reading comprehension of sixth grade students was studied 
by Schneyer. 

Robinson' made use of the technique with function- 
ally illiterate inmates of a federal penitentiary. The po- 
tential uses of the cloze procedure in reading clinics have 

3 

been described by Rankin. 

Jongsma, in a review of the literature related to 
the cloze procedure as a teaching device, offered sugges- 
tions for future research. 



-^J. Wesley Schneyer, "Us'- of the Cloze Procedure 

Comprehens..n," The Rea ding Tearher, 
19 (1965), 17^-179. . 

^5^2!?^^2,°^^^5 Robinson, "An Investigation Into 
the Use of the Cloze Procedure With a Group of Functionally 
Illiterate Adults" (unpublished Ed,D. dissertation. Uni- 
versity of Georgia, 1971). 

« .^'^i'*' "^^^^ ^"^oze Procedure in the Read- 

ing Clinic,- Reading in a Changing Society . ed..by J. Allen 
Figurel, Proceedings of the International Reading Associa- 
tion (New Yorkt Scholastic Magazines, 1959), pp. 228-232. 

m V , Eugene Jongsma, The Cloze Procedure as a Teaching 
|echniaa| (Newark, Delaware 1 International Reading Associa- 
xioiit 1971 
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ALEXANDER, HENRY V/ILLIAT*!. "AN INVESTIGATION OF THE CLOZE 
PROCEDURE AS A MEASURING DEVICE DESIGNED TO IDENTIFY 
THE INDEPENDENT, INSTRUCTION, AND FRUSTRATION READING 
LEVELS OP PUPILS IN THE INTERInEDIATE GRADES." AN UN- 
PUBLISHED ED.D. DISSERTATION, UNIVERSITY OF ILLINOIS, 
1968. 



Purpose ! Identification of a pupil's independent, instruc- 
tional and frustration reading levels are essential if aca- 
demic progress, commensurate v/ith aptitude, is to occur. 
Standardized reading tests have been found ineffective in pro- 
viding this basic information. The informal reading inventory, 
if properly constructed and administered, will provide an ex- 
aminer with this data, however, it must be given individually 
thereby precluding extensive usage for purposes of reading 
evaluation. 

The purpose of this study was to determine if a test 
predicated on the Cloze procedure (a word deletion system) 
could provide basic information similar to that obtained with 
the informal reading inventory. Because a cloze test samples 
both lexical and structural language factors, two components 
of reading comprehension, it appeared logical to propose such 
hypothesis. Secondly, the study permitted consideration of 
•?;he relationship of scores obtained with the two informal read- 
ing tests and those derived with the standardized reading test 
and the intelligence measure. 



Principles. Concepts, or Procedures : A total of 365 students 
somewhat equally distributed among the three levels of the in- 
termediate grades of a suburban elementary school system near 
the City of Chicago were the sub.iects utilized in this study. 
The numerical division of sexes was almost equal although 
slightly favoring males. Each student was administered the 
Lorge-Thomdike Intelligence Test Multi-Level edition, the 
Gates-MacGinitie Reading Tests - Survey D, an informal reading 
inventory predicated on the Powell paradigm, and a cloze test. 
These were administered in the same sequence as just presented. 
The reading passages used in the construction of the informal 
reading inventory and the cloze test were identical. At least 
one week elapsed between administration of the two informal 
tests. All examinations were completed during the month of 
February, 1968. 



A total of seventeen passages extracted from the Scott 
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Poresman, The New Basic Readers: Curriculum Foundation Series 
(1965) provided the basis of constructing the informal reading 
inventory and the cloze test# The reading difficulty level of 
the passages ranged from grade 1.6 to 9*9 with approximately 
.6 grade difference between each passage. The readability 
level of those passages taken from basals below grade four was 
determined through the application of the Spache Readability 
formula, and the excerpts taken from basals designed for use 
above grade three were analyzed with the Dale-Chall Readability 
fcjmula. 



Conclusions : Based on the statistical analysis it was possible 
to conclude that a measuring instrument predicated on the Cloze 
procedure can be expected to identify the independent, instruc- 
tional and frustration reading levels with a degree of accuracy 
comparable to that obtainable with a properly constructed and 
administered informal reading inventory when the subjects are 
elementary school intermediate grade pupils* Cloze percentage 
scores below were found to identify the frustration reading 
level I scores ranging between ^^7% and 61% demarcated the in- 
structional reaaing level with the maximum indicated by the 
ratio identical with smallest of these polarities 1 and the inde- 
pendent reading stratum hbls identified when the percentage ex- 
ceeded 61* 

Furthermore, cloze test scores correlated with outcomes 
of a standardized reading test and an intelligence scale as 
well as the correlations of the informal reading test with the 
same measurement instruments*^ 

Recommendations ; 

1) Cloze tests can be employed by teachers to identify the 
independent, instructional and frustration reading levels of 
pupils in the intermediate grades of the elementary school* 

2) The cloze percentage criteria of 62% plus - independent 
level t ^7fo through 61% - instructional level; and less than 
^7% - frustration level should be employed as only one set of 
reference points* Other ratios might be suggested on the basis 
of classroom examinational 



-'- Dissertation Abstracts At The Humanities and Socii^l 
Sciences (Ann Arbor« Michigan > University Microfilms, 1969 )# 
Vol* 29, No* 12, Part 1, pp. if31^-A, 4315-A* (Order No* 69- 
10, 625 f 253 pages)* 
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BLOOMER, RICHARD H. "THE CLOZE PROCEDURE AS A REMEDIAL READ- 
ING EXERCISE." JOURNAL OF DEVELOPMENTAL READING. 5 
(1962), 173-181.^ 



Purpose i The use of the cloze procedure as a remedial read- 
ing technique for college students was investigated. 



Principles. Concept s, or Procedures { Subjects were two groups 
of 44 students each, who were randomly selected from volun- 
teers. 

Materials for the experimental group were developed from 
elementary basal readers. Every-tenth-worc deletions wore 
used. The materials were levelled and sequenced in a way 
which allowed students to complete the program in as few as 
ten or as many as fiftji class meetings. Both students and 
instructor corrected the exercises, and both exact-word and 
synonym replacements were accepted. 

The control group used Gilbert's Power and Speed in 
Reading for two one-hour sessions each week. In both groups, 
attempts were made to control the teacher variable by assign- 
ing the instructors invigilating roles. 



Cpnclusions: The cloze procedure produced a significant in- 
crease in reading comprehension and was found to be highly 
motivating. ^ 
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BLOOMER, RICHARD H. "THE EFFECTS OF NON-OVERT REINFORCED 

CLOZE PROCEDURE UPON READING COMPREHENSION NEV/ FRON -- 
TIERS IN COLLEGE- ADULT READING ♦ EDITED BY G. B. SCHICK 
AND Mt MAY. YEARBOOK OF THE NATIONAL READING CON- 
FERENCE. MILWAUKEE, WISCONSIN: NATIONAL READING CON- 
FERENCE, 1965, 31-^0. 



Purpose t The author describes the third in a series of 
studies which was designed to compare fifth, seventh, nin'i^ 
and eleventh grade boys and girls and the long-term recall oi 
cloze materials made with various syntactical deletions 
against straight reading material and random cloze. 



Principles. Concepts^ or Procedures : Subjects were 1^11 
pupils from a regional school in upstate New York. Twenty- 
four 600-word passages were prepared and adjusted to the 
fifth grade reading level by" the Yoakum Readability Formula . 
Twelve comprehension questions were prepared for each passage. 
Each passage was prepared in seven cloze forms deleting no 
words, random words, nouns, verbs, adjectives, pronouns and 
conjunctions, and noun determiners. 

Each student was required to read six of the selections, 
complete the deletions where appropriate, and answer the 
questions. The subjects graded their own work. The study 
lasted three weeks. 



Conclusions ! 

1. . . . higher grade pupils confronted with mate- 
rial of extreme simplicity, . . . , could not de- 
rive sufficient self -reinforcement from reading 
the material or completing the cloze exercises to 
comprehend at a level better than that of the 
ninth grade. (38) 

2« . . . , as the material gets relatively more 
simpl.e, the differences between the sexes seem 
to disappear, and the tendency for boys* perfor- 
mance to be superior over girls increases. (38) 
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BLUMENFELD, JACOB P., AND MILLER, GERALD R. "IMPROVING READING 
THROUGH TEACHING GRAMMATICAL CONSTRAINTS." ELBIENTARY 
ENGLISH . 43 (1966), 752-755. 



Purpose i The authors sought to determine 

1. what :t was that good students of English did know 
about grammatical usage and poor students did not which en- 
abled the former to learn material more efficiently, 

2. if -file poor students would improve after instruction. 



Principl es, Concepts, or Procedures ; A number of college 
freshmen were administered a series of 36 cloze passages.! 
Although exact replacement scores, synonym scores, and word 
class scores were completed from the results, only the 
latter were used in this study. The Davis Reading Test was 
administered before and after the cloze exercises. 



Conclusions ? 

1. Both good and poor students of English demonstrated a 
grammatical mastery of the language when the word class re- 
sults were analyzed. 

2o No significant improvement in reading comprehension 
was in evidence after students had comple-^sd the cloze exer- 
cises. 

3. When students were taught to transform verbs and ad- 
jectives into nominalizations, reading scores showed improve- 
ment significant at the .05 level. 



The materials are described in G. R. Miller and E. B. 
Coleman, •'A Set of Thirty-Six Prose Passages Calibrated for 
Complexiby," p. 6I of this thesis. 
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BORMUTH, JOHN R. DEVELOPI^ENT OF STANDARDS OF READABILITY; 
TOWARD A RATIONAL CRITERION OF PASSAGE PERFORIvlANCES . 
FINAL REPORT TO THE OFFICE OF EDUCATION, DEPARTMENT OF 
HEALTH, EDUCATION, AND WELFARE, PROJECT NO. 9-023?. 
CHICAGO: UNIVERSITY OF CHICAGO, JUNE 1971. 



The author presents a composite of five studies designed 

... to develop and demonstrate a model for identi- 
fying criterion levels of performance for a particu- 
lar instructional task. The specific objective was 
to identify the score on a cloze test that represents 
the most desirable level of performance on instruc- 
tional materials, (viii) 

Studies I-IV will be reviewed; Study V deals with teach- 
ers* ratings rather than an application of the cloze procedure 



STUDY I-^ 

Purpose t The purpose of this study was 

... to determine how closely, if at all, the re- 
gressions between the information gain and cloze 
mesCsures obtained from different passages resembled 
each other, and also to examine the shapes of those 
regressions. (32) 



Principl es t Concepts, or Procedures : A 52-item cloze test was 
made over a 263-word passage from a psychology textbook and 
was administered to 26o students enrolled in grades 3, 5, ?, 
and 11, as well as sophomore and graduate students for the pur 
pose of matching the subjects by pairs for reading ability. 

Five forms of a cloze test were made from each of two 
passages from the textbook. Every-fifth-word deletions were 
used, so that all words became items requiripg replacement. 
Two multiple-choice tests were prepared for these same pas- 
sages. 



See also John R. Bormuth, "Einpirical Determination of 
the Instructional Reading Level," Appendix. 
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The tests were administered in three sessions over a two- 
week period. There were no time limits. 



Conclusions J Neither of the two regressions fell consistently 
above the other in the range where comparisons were possible. 
The shape of the regression curve was approximately similar to 
a normal ogive curve. 

The fact that the two curves were nearly identical 
in their parameters indicated that the methods used 
to construct the comprehension tests were likely to 
produce tests having at least a useful degree of 
conformity to the instruction and to measure a fair- 
ly uniform set of behaviors across passages. (^0) 



STUDY II 

Purpose t Because of a number of limitations inherent in the 
design of the first study, further exploratory work was deemed 
necessary and refinement undertaken. 



Principles, Concepts, or Procedures ! 

... a design was used that permitted all data to 
be gathered in a single testing session. This was 
achieved by giving the student a cloze test over 
one passage and a preference rating scale and pre- 
and post-comprehension tests made from a second 
passage of matched difficulty, (^f?) 

The passages were chosen from the Gray Oral Readingr Para - 
graphs (1963 edition). Each test booklet contained cloze and 
completion tests made over two passages which had been matched 
for difficulty. 

Subjects were I320 students enrolled in grades 3 through 
12 in a suburban community. 



Conclusions » 

The really fundamental methodological problem of 
devising a direct test of the regression identity 
assumption was not solved and remained unsolved at 
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the time this report was being prepared. The sub- 
stantative problems consisted of determing whether 
different performance criteria must be derived for 
students at each grade level and materials at each 
difficulty level. ... It was also necessary to 
make a digression into the study of motivation theory 
and then to reassess the methods used to measure pre- 
ferences for materials. (75) 

The results clearly indicated that it is necessary 
to calculate separate performance criterion scores 
for students at every grade level. (77) 

It appeared unnecessary to calculate different cri- 
terion scores for different levels of passage diffi- 
culty. (77) 



STUDY III 



Purpose t "This study attempted to obtain regiressions that 
would be useful for at least tentatively identifying perfor- 
mance criterion scores." (79) 

Three specific objectives werei 

1. . . . to analyze and model the concept of a 
rationally derived performance criterion. (79) 

2. . . .to further analyze the preference rat- 
ings of passages and to obtain the regressions 
of those ratings and of information gain scores 
on cloze scores. (79) 

3» . • • to further develop the procedures for con- 
structing comprehension tests. (79) 



Principles t Concepts, or Procedures ! 

The testing design used in the preceding study proved 
to be highly efficient and so was retained for this 
study, but with three major alterations. First, each 
• of the four types of tests taken by a student was made 
rrom a different passage. ... The second alteration 
was to employ passages that could be said to be more 
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representative of instructional materials. The third 
alteration was to employ longer passages and compre- 
hension tests in order to obtain more reliable results 
on the cloze and information gain tests. (81) 

The study 

. . . involved 10 grade levels of students crossed by 
8 levels of passage difficulty, with four passages 
nested within each difficulty level and five cloze 
test forms nested within each cloze passage. (86) 

Each of the 1600 subjects therefore completed different 
booklets. The study lasted three weeks. 



Conclusions: Before the obtained regressions can be appli- 
cable, items beyond those in the area of literal comprehension 
will have to be added. 

The preference scales added to this study indicated that 
a student's willingness to study is greatly influenced by sub- 
ject matter, style, and passage difficulty as well as the use 
made of the passage. 



gjTUDY IV 

Purpose: The relationship between rate of reading and cloze 
scores was investigated. 



Principles. Concep ts, or Procedures ; "The materials and pro- 
cedures followed in this study were nearly identical to those 
in Study III." (119) 

Twenty students at each of three grade levels - 4, 7. and 
10 - were subjects. 



Conclusions: "The students at the higher grades appeared to 
show more rapid rates of reading than the students at lower 
grade levels." (120) 
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SUMMARY 

In assessing the validity of the thirty performance cri- 
terion scores produced by the model in its current stage of 
devfelopment, the author underscored three points. 

1. . • .it appears that the subject matt3r, style, 
and willingness to study preference ratings are 
the dominant variables in determining where the 
criterion score is set by the model. 

2. . . . the model dictates that as students reach 
higher grade levels they should be given more 
difficult materials. 

3» • • . the model generally dictates that students 
be given easier materials for use in textbook 
reading than for reference and voluntary reading. 
(140 -l5l) ^ 
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PAUBION, NORMA NELL. "THE EFFECT OP TRAINING IN THE USE OF 
CLOZE ON THE ABILITY OP FOURTH GRADE PUPILS TO GAIN IN- 
FORMATION FROM WRITTEN DISCOURSE." UNPUBLISHED PH.D. 
DISSERTATION, TEXAS A&M UNIVERSITY, I97I, 

gurpose t Two experimental groups and a control were employed 
ror this research which was designed to measure the effect of 
cloze training upon the reading comprehension of fourth grade 
pupils when the training focused upon the use of structure 
words and verbalization by students concerning responses to 
cloze exercises. 

y>rinciples, Concep t s, or Procedures : Three fourth grade class- 
rooms in an elementary school in South Texas were randomly 
assigned to the two treatment groups and the control. 

1,.,^!,^^^^^*^?®^ random samples of passages, approximately one 
hundred words in length, were taken from three social studies 
textbooks. The passages were assigned to one of two forms of 
a cloze test of ability to gain information. The two forms 
were administered to a group of fourth grade students for the 
purpose of establishing reliability. Reliability scores of 
al^^f^^ ^^^^ obtained for Form A and Form B respectiv#?ly. 

Stratified random samples from the three textbooks were used 
to develop a series of ten cloze lessons, each containing two 
cloze exercises. Half of the exercises utilized the fifth- 
word deletion pattern and half utilized a structure word dele- 
xion pattern. 

• f^f"*f 3t measures of reading comprehension were taken by 
?Jti;^S^ ^l^^and the Stanford Rea d ing Achievement ^ 
iest, Form W, The treatment phase covered a period of ten — 
-fiff:* Subjects in the control group participated in a daily 
f;;^n?of!^ i®^^?" based on passages from which the cloze 
exercises were developed. In experimental A, subjects were 
fin?«o« ^^""^ addition, the corrected ex- 

tltltl ^ ? V^t previous day were returned and the subjects 
were requested to note the corrections. This procedure was 
«fniT2 fof^en consecutive school days. Subjecra in experi- 
mental B followed the same procedure as experimental A with 
one exception. When the corrected cloze lesson was returned, 
the subjects were encouraged to verbalize aboi t the appropri- 
ateness or lack of appropriateness of their responses. Post- 
test measures of reading comprehension were taken by adminis- 
tering the CTAGI and the Stanford Reading Achievement Test . 
Jrom A* ~-- — 



ERIC 



195 



Conclusions ; Three null hypotheses were generated as part of 
the original design of this study. No significant difference 
was found between students who received training in the use 
of cloze and students who did not receive training in the use 
of cloze as measured by the CTAGI, the CTAGI; Structure Words , 
and by the Stanford Reading Achievement Test . Thus, the three 
null hypotheses were not rejected. A fourth null hypothesis 
was generated, that there would be no significant difference 
in performance between students who received training in the 
use of cloze and those who did not receive training as mea- 
sured by the CTAGI » Lexi cal Words . A significant difference 
was found at the .05 level of confidence. This resulted in 
the rejection of the fourth hypothesis. 

was unable to demonstrate that 
training in the use of cloze resulted in growth in comprehen- 
sion skills, the study seemed to indicate that there night 
have been certain variables which influenced the effectiveness 
of cloze training. It was, therefore, recommended that re- 
search efforts be directed toward the identification of the 
effect of the interaction of such variables as reinforcement, 
the deletion pattern, and the types, of materials utilized for 
the development of cloze exercise s.-"- 



. e, Digsertation Abstrac ts International A. The Humanities 
ana social Sciences (Ann Arbor, Michigan « University Micro- 
films, 1972). Vol. 32, No. 8, p. W6-A. (Order No. 72-5655, 
164 pages). J jj% 
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FRIEDMAN, MILDRED MCELHINNEY. "THE USE OF THE CLOZE PROCE- 
DURE FOR IMPROVING THE READING COMPREHENSION OF FOREIGN 
STUDENTS AT THE UNIVERSITY OF FLORIDA." UNPUBLISHED 
ED.D. DISSERTATION, THE UNIVERSITY OF FLORIDA, 196^^. 



Purpose ; Although the need for foreign languages has been in- 
creasing vastly, there is as much confusion about the approach 
to language teaching as there was centuries ago. Throughout 
its history, the methods and emphases of language teaching have 
recurred in cycles. The advocates of each method have disre- 
garded the aims of their teaching or accepted the popular 
method as the panacea. As a result, language teachers are 
groping for answers. Research is essential to clarify the 
issues and to improve the results of language teaching. 

The purpose of this study was to find another successful 
method for improving reading comprehension for foreign stu- 
dents. By using the cloze procedure (a word deletion system), 
it was hoped that simple materials could be made interesting 
enough for mature students. Because cloze samples both the 
lexical and structural factors of a language, certain insights 
into language learning were expected. 



Principles, Concepts , or Procedures: Three classes of foreign 
students in English C-33 and C-3^ at the University of Florida 
were used as subjects one day a week for one trimester. Two 
classes were given a series of twenty deleted readings, called 
cloze tests, from McCall Crabbs Standard Test Lessons in Read - 
ing. Books A to E (Grades 3 to 7T' The other class was given 
the same readings undeleted. All groups were given a multiple- 
choice test after each reading. 



Conclusions » The design of this study produced data from the 
pre- and post-test scores from the Metropolitan Achievement 
Test. Reading Section . Intermediate Level and a vocabulary-in- 
context test, based on the vocabulary subtest of the MAT, and 
from the errors on the cloze and multiple-choice tests. The 
following conclusions were reached from these data. 

1. The cloze procedure is as effective in producing im- 
provement in comprehension and vocabulary-in-context as a 
method using close reading without deletions. The t tests, 
applied to these changes, indicated that gains were~signif i- 
cant for all groups but not between groups. 
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2. The validity of the cloze procedure as a measure of 
comprehension for foreign students has been established by 
its significant correlation with the MAT and the multiple- 
choice tests« 

3. A complete knowledge of the vocabulary is not essen- 
tial to the understanding of a reading if the subject matter 
is within the experience of the student. Cloze measures 
familiarity with the subject as well as the difficulty of the 
article. This may confuse the readability scores. 

The following implications and recommendations were 
formulated : 

1. Since one experimental group made significant gains 

in vocabulary, the cloze procedure may be superior to the close 
reading method in improving vocabulary. PYirther studies should 
be made in the use of cloze to improve vocabulary. 

2. Students report that they are aware of the patterns 
ol the language when they do cloze tests. It is possible that 
the cloze procedure might be a successful method of teaching 
and testing structure. Investigations in the relationship of 
structure to reading would prove most helpful to language 
teachers. 

3» Further study needs to be made on the permanency of 
the gains with the cloze procedure. It seems quite probable 
that the need of close observance of language patterns p.nd 
the development of skill in using context and in finding re- 
lationships might establish a more permanent gain than other 
methods. 

^. The influence of personality rigidity upon the re- 
sults of the cloze procedure and the use of cloze to break the 
habits of rigidity are factors observed in this study which 
need further research. 1 



Dissertat ion Abstracts (Ann Arbor, Michigan » Univer- 
sity Microfilms, 196^), Vol. 25, No. 6, pp. 3420-3^21. 
(Order No. 64-11,533, 124 pages). 
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GUICE, BILLY MILTON. "AN EXPERIMENT COMBINING INSTRUCTION IN 
COMPREHENSION WITH PRACTICE IN THE CLOZE PROCEDURE IN 
READING." UNPUBLISHED ED.D. DISSERTATION, UNIVERSITY OF 
SOUTHERN MISSISSIPPI, I966.I 



Purpose ! The problem of this research was to experiment with 
the cloze procedure as a technique for teaching reading compre- 
hension skills to college students enrolled in an improvement 
of study course at the University of Southern Mississippi dur- 
ing the winter quarter, 1965-1966. 

The purpose of this study was to ascertain whether a group 
of college students, who rece5.ved regular instruction in read- 
ing comprehension plus instruction in and practice with the 
cloze procedure, would make significant gains in comprehension 
when compared with a group of collage students who received 
only regular instruction in comprehension. Some additional 
information that this study sought to reveal was the relation- 
ship between comprehension and successful clozure, creativity 
and successful clozure, intelligence and successful clozure, 
and comprehension and creativity. 



Principles, Concepts* or Procedures : The Improvement of 
Study Course was scheduled in two sections, one at 10:00 A.M. 
and the other met at 1:00 P.M. The lecture sessions for both 
sections met on every Monday of the quarter. Each of the two 
lecture sections was broken into two laboratory groups. For 
the entire quartert at its respective hour, one laboratory 
group met on Tuesday and Thursday and the other met on V/ednes- 
day and Friday. Each period of work was fifty minutes in 
duration, three days per week. 

Through the use of the table of random numbers and stan- 
dard randomization procedure, the seventy-six students were 
randomly assigned to one of the two scheduled lecture sections. 
The students enrolled in the morning lecture section were fur- 
ther randomly assigned to one of the two morning laboratory 
groups. Likewise, the students enrolled in the afternoon 
lecture section were further randomly assigned to one of the 
two afternoon laboratory groups. 



See also Billy M. Guice, "The Use of the Cloze Procedure 
for Improving Reading Comprehension of Cola.ege Students," 
Appendix. 
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One morning laboratory group and one afternoon laboratory- 
group were randomly selected as the experimental group. The 
remaining morning and afternoon laboratory groups were the con- 
trol group. No student was allowed to change either his lec- 
ture section or his laboratory group assignment. 

The Cooperative English Tests. Forn u_ Form IB. Read - 
ing Comp-'ehension . The Guilford. Merrifi^. . and Chr istensen 
Test of Creativity "Consequences ." and The Guilford, Merri - 
field. Christensen. and Wilson Test of CreativitV "Alter nate 
Uses." Form A . and The Otis Quick-Scoring Test of Kent? 1 Abili - 
ties wers used to collect the data. 

The selection of materials used in teaching reading com- 
prehension was based upon the detailed analysis of both forms 
of The Cooperative English Tests. Reading Comprehension . The 
course content emphasized the following reading comprehension 
skills as a result of the analysis of the tests-, main ideas, 
specific details, inferences, conclusions, interpretations. 

The series of cloze exercises were based on college level 
materials from recently published work texts. The cloze dele- 
tion techniquj was applied to each of the selected passages. 
Each deletion was replaced by an underlined blank space, 
twelve typewritten spaces wide. The deletion technique em- 
ployed in the cloze exercises was based on every nthcconcept 
word— noun, verb, adjective, or adverb as determined by the 
Department of English, The University of Southern Mississippi. 

The cloze passages were given to the students during the 
laboratory periods and after each exercise was completed, it 
was scored by the instructor. The exercises were graded 
allowing two points for a cloze un5t and one point for an 
acceptable clozure synonym. The corrected passage was re- 
turned to the student at the following laboratory period. 



Conclusions ; The data were divided into three parts for 
treatment. First, the data were entered into a Lindquist 
Type III analysis of variance. Secondly, Pearson Product- 
Moment correlation coefficients were computed between compre- 
hension and successful clozure, creativity and successful 
clozure, intelligence and successful clozure, and comprehen- 
sion with creativity. Lastly, the data were subjected to a 
multiple correlation analysis. 
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-« hp^!!rJ^f!-°^?''®".^°?if experimental and control failed 

a^^o^i significant at the .05 level and thus did 

■ - upport the major hypothesis of this experiment. 

An unexpected finding was the statistically significant 
pre-post-test, time interaction (P < .01). The change "'n 

?ess" ?SaV?he'"'o'f\e'vel^''.f wa'%?|^?ficant at 

i^ff+- -2 ^he .01 level. The highest correlation was between 
creativity and clozure .79^ significant at the .01 llvel of 
confidence. The correlation between intelligence and crea 

significant at the .01 levejf Comprehension 
o? '^^''^^ correlated .636 significant at the !Sl ?eSel 

SLSensio^;^nr;r.o'!-^-r"!i''^ relationship betw;ei com- 
8iIni??caSt a? til ni^^l o?^ correlation of .602 was likewise 
exgnxiicanx at the .01 level. The correlation hotwo^^n ^^+^n^ 

gence and closure MO „as significlnrat tie .S5 levSl o? si« 
wnfldence?! significant at the .05 level of 



i^"l'^S'""U'5^!''^«?S'. University Miorofilmsri^l?), 
»0I. 28, No. 1, p. WJ-A. (Order No.. 67-8740, I95 pages). 
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GUSCOTT, CHARLES EDGAR. "THE EFFECT OF CLOZE PROCEDURE EXER- 
CISES ON THE IKPROmiENT OF READING ACHIEmiENT AMD OF 
READING COMPREHENSION OF SELECTED SIXTH-GRADE STUDENTS." 
UNPUBLISHED PH.D. DISSERTATION, THE UNIVERSITY OF AKRON. 
1971. 



Purpose ; The purpose of this investigation was to assess the 
effect of cloze procedure exercises as defined in the study- 
on selected sixth-grade student's ability to comprehend their 
assigned social studies text and their performance on a stan- 
dardized test of reading achievement. 



Principles. Concepts, or Procedures : A readability study of 
the social studies text used by the selected students and a 
cloze procedure comprehension test using every fifth word de- 
letions demonstrated the need for giving attention to the read- 
ing problem. The Dale-Chall formula was used to assess the 
difficulty of the text. A stratified random sample was drawn 
from the six selected suburban schools. The sample was drawn 
on the basis of reading achievement stanine scores. N = 60. 

Cloze procedure exercises were constructed using noun de- 
terminer deletions. Materials were taken from unfamiliar por- 
tions of the social studies text. Exercises were presented in 
the form of overhead transparencies and numbered answer sheets 
for a period of eight school weeks. 

Post-testing was of two kinds: (1) a cloze procedure test 
based on unfamiliar social studies material and employing every 
fifth word deletions, and (2) Iowa Tests of Basic Skills. Read - 
ing. Form I . 



Conclusions : Employing a 2 x 3 factorial analysis of variance 
it was found that the cloze exercises did produce significantly 
better scores on the standardized test of reaching achievement 
but did not result in significantly better scores on the cloze 
comprehension test. An analysis of interactions indicated that 
effect was not related to levels of achievement. It was con- 
cluded that cloze exercises as defined in the study had differ- 
ent effects on different levels of reading achievement. Al- 
though, on the average, effect on achievement was significant, 
it was not transferred in a significant way to the functional 
reading situation by any level. 1 



^Dissertation Abstracts International A: The Humanities 
and Social Sciences (Ann Arbor. Michigan: University Micro- 
films, 1972), Vol. 32, No. 7, p. 3861-A. (Order No. 72-^^051, 
93 pages). 
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GUSZAK, FRANK J. A COMPARATIVE STUDY OF THE VALIDITY OF THE 

CLOZE TEST AND METROPOLITAN ACHIEVEMENT TEST (READING COM- 
PREHENSION SUBTEST) FOR MAKING JUDGMENTS OF INSTRUCTIONAL 
LEVELS. AUSTIN, TEXAS « UNIVERSITY OF TEXAS, 1969. 



Purpose t The use of the cloze procedure to determine instruc- 
tional reading levels for pupils in grades 4, 5, and 6 was in- 
vestigated. 



Principl es. Concepts, or Procedures » For each grade, 50 sub- 
jects were selected who, on the basis of teacher judgment, were 
reading at their respective grade levels. The Botel Reading 
Inventory. Form A (Word Opposite 'j') served as the criterion for 
instructional level. Compared with the Botel Test scores were 
scores from three cloze tests for each grade level (below grade 
level, at grade level, and above grade level) and the scores of 
the Reading Comprehension subtest of the Metropolita n Achieve- 
ment Tests. ' 



Conclusions » Findings revealed relatively low correlations 
(.11 to .18) between the Botel and the cloze tests. The Botel 
and the Metropolitan tests correlated fairly hi^h at grades ^ 
and 5 (.^9, .21), and showed a statistically significant differ- 
ence at grade 6. No significant relationships were noted be- 
tween the cloze test instructional levels and the Metropolitan 
Test scores. It was suggested that different means of assess- 
ing comprehension may have accounted for low correlations be- 
tween the cloze and the Botel tests. Tables and a bibliography 
are included. 1 



^Research in Education (Washington, D.C. « United States 
Government Printing Office, 1970), Vol. 5, No. 9, p. 79. 
(ED 039 108, 36 pages). ^ . ^ 
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H/ T^ER, LAWRENCE ERHARDT, "AN EXPERIMENTAL STUDY OP THE 

EFFECT ON VARIOUS READING ACHIEVEMENT SCORES OF TEACHING 
SELECTED CONTEXT AIDS TO A GROUP OF FIFTH GRADE PUPILS," 
UNPUBLISHED ED.D. DISSERTATION, UNIVERSITY OF MISSOURI, 
1960.1 



Purpose t To evaluate the effects on reading achievement scores 
of an experimental group of fifth grade pupils of teaching the 
nature and use of selected context aids. The achievement tests 
used were designed to measure reading comprehension, vocabulary- 
in-context, and context comprehension, and to yield a vocabu- 
lary-comprehension composite called average reading. 



Principles. Concepts, or Procedures : 

1. The reading achievement of the experimental group was 
compared to the reading achievement of two control groups. The 
experimental group and the control-I group were two fifth 
grade classes in the same school. The control-II group came 
from a school located in a more favorable environmental setting. 

2. Characteristics of the groups in terms of intelligence 
and reading achievement were obtained at the beginning of the 
experiment. The California Test of Mental Maturity , the SRA 
Reading Test, and the C omprehension "X" Test (constructed~by 
the writer) were used as pre-test instruments. Because of in- 
equalities existing among the groups in intellectual and read- 
ing achievement status, the analysis of covariance statistical 
technique was utilized. A chi-square technique and the "t" 
test of the significance of the difference between means were 
also utilized. 

3. The experimental variable was instruction in the use of 
these selected context aids: contrast, explanatory words and 
phrases, and two inferential aids. Instruction was given for 
three thirty-five minute periods per week for a total of four 
weeks. 

^. At the end of four weeks the pupils of all the groups 
were administered an alternate form of the reading achievement 
tests. 



See also Lawrence E. Hafner, -A One-Month Experiment in 
ng Context Aids in Fifth Grade," Appendix. 
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Conclusions » 

1. After short term instruction in the use of context 
aids, none of the comparisons made in the reading achievement 
areas of comprehension, vocabulary-in-context, average reading, 
and context comprehension demonstrated unequivocally the influ- 
ence of the experimental method. 

2. Though short term instruction in the use of context 
aids did not differentiate between the experimental and the 
control groups in a statistically significant manner, there is 
a suggestion that it is in the area of vocabulary-in-context 
achievement that the teaching of context aids would be most 
productive. 

3» In the situation where children were similar in intel- 
ligence and background of experience, more of the children who 
had received instruction in the use of context aids made gains 
in comprehension than was the case with children who had not 
received such instruction.! 



j-Pissertation Abstracts (Ann Arbor, Michigan* University 

21, r^o. 12, p. 37U. XL. C. card No. 

Mic 60-6806, 137 pages). 
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HUNTER, CHARLES F. "CL02ING THE GAP: AN APPROACH TO SOLVING 

READING PROBLEIvlS AT SAN JOSE CITY COLLEGE." PAPER PRESEN- 
TED AT THE MEETING OF THE V/ESTERN COLLEGE READING ASSOCIA- 
TION, LOS ANGELES, CALIFORNIA, APRIL 1-3, I971, 



Purpose t The necessity to provide instruction in reading is 
widespread in community colleges, due primarily to the liberal 
enrollment policies these colleges generally have. 



Principl es, Concepts, or Procedures ; The program at San Jose 
City College uses the Davis Reading Test and the Iowa Silent 
Reading Test as part of its entrance battery and assigns stu- 
dents to either regular or one of two noncredit, pass-fail, 
remedial English classes on the basis of scores on the speed 
section of the Davis test. Regular English instructors, 
reading teachers,- and graduate students in English acting as 
paraprofessionals teach the remedial reading and writing sec- 
tions. Emphasis is on skill development, beginning with 
isolated skill areas and working toward integration of skills 
in successful critical reading. Machines such as tachisto- 
scopes and language masters supplement class instruction, and 
the use of clozure activities to strengthen vocabulary and 
comprehension has been particularly successful. 



Conclusions : Evaluation of 310 students in remedial sections 
in the spring of 1970 showed an average gain of nearly 2 years 
as measured by the Iowa test. Future plans for the program in- 
clude extending instruction into various departments of the 
college. References are included. 



^Research in Education (Washington, D.C.i United States 
Goverpent Printing Office, 1971), Vol. 6, No. 8, p. 70. 
(ED 0^^9 895. 9 pages). ^ 
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JONGSMA, EUGENE. THE CLOZE PROCEDURE AS A TEACHING TE CHNIQUE. 

NEWARK, DELAWARE: INTERNATIONAL READING ASSOCIATION, 

1971. 



Purpose ; The author states three purposes: 

1. to review the literature related to the use of cloze 
as a teaching technique. 

2. to organize and synthesize the literature. 
3» to offer suggestions as to future research. 



Principles. Conce nts, or Procedures : The work of Bloomer, 
Friedman, Schneyer, Blumenfeld and Killer, Heitzman and Bloomer, 
Martin, Guice, Roossinck, and Kingston and Weaver is reviewed.^ 

Jongsma isolates several weaknesses which have been charac- 
teristic of many of the studies utilizing cloze as a teaching 
technique. 

1. Lack of direct teaching and over-reliance on pupils* 
completion of exercises alone. 

2. Lack of a lucid definition of the problem. 
3» Weak experimental designs. 

4. Measurement problems which interfered with true assess- 
ment of growth. 

5» Inadequate descriptions of studies. 

Bec^use of the disparate efforts of the past, Jongsma 
makes several recommendations for future studies: 

1. Development of teaching strategies be they teacher-pupil, 
small group, or whole class in nature. 

2. Investigation of presentation methods 

- Complete cloze exercise 



These sources may be found elsewhere in this chapter, ex- 
cept the last two which are listed in Section II of the Appendix. 
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- complete cloze exercise answer multiple- 
choice questions 

- read intact passage — > complete cloze exer- 
cise 

- complete pre -close — > read passage — ♦ 
complete post-cloze . 

3. Use of shifting scoring methods wherein grammatical 
class responses, synonyms, and later exact replacements are 
requested. 

4. More intense and longer studies. 

5* Statement of specific, desired outcomes. 

6. More attention to the choice of deletion system. 

?• Use of cloze in areas such as context clues, vocabu- 
lary development, and content reading. 

8. Less attention to experimental-control comparisons and 
more to factorial designs. 

9* More attention to randomization. 

10 • Better measurement procedures. 

11. Adherence to guidelines when reporting research. 



Conclusions » Because past studies utilizing cloze as a 
teaching device have failed to significantly improve reading 
proficiency should encourage future research if errors and in- 
adequacies of the past are ameliorated. 
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KIRBY, CLARA LOU LAUGHLIN. "A COMPARISON OF SCORES OBTAINED 
ON STANDARDIZED ORAL AND SILENT READING TESTS AND A 
CLOZE TEST." UNPUBLISHED ED.D. DISSERTATION, BALL STATE 
UNIVERSITY, 1967.1 



Purpose t The purpose of the study was to determine the rela- 
tionship, if any, that exists between the reading levels of ele 
mentary school children as indicated by scores received on a 
cloze tesx and scores received on selected oral and silent stan 
dardized reading tests. 



Principl es. ConceT3ts, or Procedures ; Related hypotheses were 
tested to determine if the relationship would be similar for 
various sub-groups of the sample population. These sub-groups 
were composed of boys, girls, outstanding readers, able readers 
less able readers, high ability students, low ability students, 
and pupils at each grade level, one through six. 

The population for the investigation consisted of 178 ele- 
mentary school children in grades one through six enrolled in 
one public school in a Midwestern city. Ninety-eight boys and 
eighty girls constituted the sample. The mean I.Q. for the 
group, was 101. 7. 

Instruments employed in the study for comparison purposes 
included the Gates Reading Tests (Primary, Advanced Primary and 
Survey), the Gilmore Oral Reading Test , the Gray Oral R eading 
Test and a cloze test. All were administered within a six-week 
period beginning February 22, I965. 



Cpnclusions; Data were analyzed by simple analysis of variance 
ratios, t tests, and inspection. Problems were stated in terms 
of null hypotheses and the .01 level of confidence was employed 
to determine significance of F ratios and t tests. 

Analysis of data resulted in the following major findings 
relative to the sample employed in this study: 

1. Statistically significant differences existed among 
means of scores obtained on the cloze test, Gates Reading Tests . 
Gilmore Oral Rea ding Test , and the Gray Oral Reading; Test for 
elementary school children in grades one through six. 

m ^i^^^S ^^^^^ ^' Kirby, "Using the Cloze Procedure as a 

Testing Technique," Appendix. 
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2. There were no statistically significant differences 
among the means of scores obtained on the four instruments at 
the fifth and sixth grade levels, for high ability students, 
and for outstanding readers. 

3. Mean scores on the cloze test did not differ signifi- 
cantly from those derived from the Gilmore Oral Reading Te st 
(when the accuracy and comprehension scores were averaged) at 
any level or for any sub-group. 

^. The Gates Reading Tests yielded consistently higher 
mean scores than did the other three instruments. 

5« The Gray Oral Reading Test yielded consistently lower 
mean scores than did the other three instruments. 

Interpretation of findings led to the following major con- 
clusions : 

1. The cloze test, Gates Reading Tests . Gilmore Oral Read - 
ing Test , and Gray Oral Reading Test do not appraise equiva- 
lently the reading attainment of elementary school children in 
grades one through six. 

2. The four instruments do not measure equivalently the 
reading achievement of pupils for grades one through four, 
boys, girls, low ability students, able readers, and less able 
readers. 

3. Generally, the four instruments identify reading 
isvels comparably for pupils in the intermediate grades and 
for superior readers. 

4. Within the limits of the study, the cloze test yields 
reading level scores nearly comparable to those of the Gilmore 
Oral Rea ding Test (when word accuracy and comprehension scores 
are averaged on the Gilmore instrument). 

5« As elementary school children develop increased read- 
ing skill, the four instruments tend to yield less dissimilar 
results. The findings of this study indicate that the use of 
a cloze test by classroom teachers for determining instruction- 
al reading levels of children is a promising technique. 1 



•'• Dissertation Abstracts At The Humanitip s and Social 
Sciences (Ann Arbor. Michigrant University Microfilms, I968 ) , 
Vol. 28, No. 11, pp. ^512-^513. (Order No. 68-32^3, 125 
pages). 
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KIRCHHOFF, LEO HENRY. "A STUDY UTILIZING THE CLOZE TEST PROCE- 
DURE TO DETERMINE READING LEVELS OF FIRST GRADE CHILDREN 
WHO HAVE BEEN TAUGHT BEGINNING READING BY FOUR DIFFERENT 
APPROACHES." UNPUBLISHED ED.D. DISSERTATION, UNIVERSITY 
OF KANSAS, 1968. 



Purpose t The investigation was designed to determine whether 
or not a significant relationship existed between scores on a 
cloze test and scores on an Informal Reading Inventory when 
administered to first grade children who have been taught be- 
ginning reading by four different approaches. The four differ- 
ent approaches employed in this study were: Initial Teaching 
Alphabet . Sullivan Programmed Reading . Linguistics, and Basal. 

The 15 hypotheses involved four basic problems: (1) the 
correlation of reading levels for the entire population on a 
cloze test and an informal reading inventory, (2) the correla- 
tion of reading levels obtained on the cloze tjst and informal 
reading inventory for first graders who had been taught by four 
different approaches to the teaching of beginning reading, (3) 
the correlations of levels identified on the cloze test and the 
informal reading inventory for boys and for gii Is, (M) correla- 
tions were determined to find if differences existed among the 
four different approaches to the teaching of beginning reading 
regarding eight variables when the measured mental capacity was 
held constant. 



Principl es. Concepts, or Procedures : The population consisted 
of 120 first grade students who were selected at random from 
four school districts located in Johnson County in the state of 
Kansas. The four districts identified emphasized a different 
approach to the teaching of beginning reading. A cloze test, 
an informal reading inventory, a silent reading test, and an 
intelligence test ware used in the investigation. All testing 
was completed near the end of the first grade year during a 
five week period. 

Coefficient correlations were used to compare three read- 
ing levels, independent, instructional, and frustration. These 
levels were determined from pupil responses on the cloze test 
and the informal reading inventory. 



Conclusions: The reading levels derived from the use of the 
cloze test correlated with the informal reading inventory at 
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the .05 level of confidence for the total population in first 
grade . 

The instructional and frustration reading level results 
were significantly correlated at the .05 level of confidence 
for all first grade students who had been taught beginning 
reading by four different reading approaches. The indepen- 
dent reading level results were significantly correlated at 
the .05 level of confidence for the first grade students who 
had been taught beginning reading by the Sullivan Progrrpmrned 
Reading . Linguistics, and Basal. The independent reading 
level results for the students who had been taught beginning 
reading by the Initial Teaching Alphabet approach were not sig 
nif leant at the .05 level of confidence. The cloze test and 
the informal reading inventory, for boys and girls separately, 
provided statistically significant scores for all reading leve 

As a result of the statistical analysis, utilizing the 
analysis of covariance, it was concluded that there were no 
significant differences among the four different approaches to 
the teaching of beginning reading regarding eight variables. 

The correlations between the cloze test scores and the in 
formal reading inventory scores at the instructional and frus- 
tration reading levels were statistically significant. This 
close relationship would tend to indicate that a cloze test 
could aid the fi?st grade teacher in determining the appropri- 
ate reading level for children nearing the end of their first 
grade experience. Cloze testing can be administered, simul- 
taneously, to an entire class and thereby save time in deter- 
mining the reading levels of children. The average length of 
time required for administering the cloze test xo first gra- 
ders, as a group, approached 36 minutes. The cloze procedure 
is easily administered and interpreted by classroom teachers 
who have not had special training in test administration. l 



Dissertatio n Abstracts A; The Humanities and Social 
Sciences (Ann Arbor, Michigan: University Microfilms, 1969), 
Vgl. 29, No. 10, p. 3329-A. (Order No. 68-17,^08, 213 pages). 
/-Gates-MacGinitie Reading Tests- - Form Al, and "The Lorge- 
Thorndike Intelligence Tests," Level 1 and 2, Form A, follow- 
ing page 204 not microfilmed at request of author. Available 
for consultation at University of Kansas Librar^. 
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MARTIN, RUBY WHEELER. "TRANSFORMATIONAL GRAMR, CLOZE, AND 

PERFORItlANCE IN COLLEGE FRESHEN." UNPUBLISHED ED.D. DIS- 
SERTATION, SYRACUSE UNIVERSITY, I968. 



Purpose t This study was designed to examine the relative effec- 
tiveness of two experimental programs in improving the language 
arts skills of a group of Negro college freshmen. The two pro- 
grams were taught as a part of a freshman course in English. 
The two experimental treatments— instruction in transformation- 
al grammar and the completion of cloze exercises — were admin- 
istered to comparable groups of Negro college freshmen, and 
their pre-treatment and post-treatment scores on reading, writ- 
ing, and listening are compared to determine gains made and 
significance of difference between gains made in language arts 
skills. 



Principles. Conce pts, or Procedures t This study was conducted 
at South Carolina State College in Orangeburg, South Carolina 
during the 1966-67 school year. . The one hundred students which 
comprised the treatment groups were selected from the four hun- 
dred fifty freshmen registered at State College during the ex- 
perimental year. In addition, forty-two freshman students pro- 
vided the population with which the basic competencies of the 
treatment groups were compared on several measures. 

During the experimental period, one treatment group de- 
voted eighteen sessions to transformational grammar. The other 
group devoted eighteen sessions to completion of cloze exercises. 
The nontreatment group followed the regular syllabus for Fresh- 
man English and Composition. Instructors were regular teachers 
of English in the Communications Center, South Carolina State 
College. Criterion measures were the Iowa Silent Reading Tests , 
■the STEP Writ ing Test . Writing Sample , the STEP Listening Test , 
and the Delancey Test of Linguistic Structures . 



Conclusions t The two treatments produced significant differen- 
tial gains on pre- and post-test measures of reading, writing, 
listening, and recognition of linguistic structures. It was 
found that gains made in reading, writing, listening, and recog- 
nition of l:nguistic structures were not significantly different. 
Therefore, neither experimental treatment was superior to the 
other for these variables. 



When treatment groups were compared on writing ability with 
a comparable nontreatment group, it was found that both treat- 
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ment groups were superior to the nontreatment group. No sig- 
nificant difference was found for the three groups on total 
English achievement as measured by the Cooperative English 
Tests. A comparison of the two trtatment groups with the non- 
treatment group on listening revealed a significant F. In 
this analysis the cloze group was favored with the highest 
mean score. ^ 



^ Dissertation Abstracts Internatio n al A: The Humanities 
and Social Sciences (Ann Arbor, Michigan: University Micro- 
films, 1969), Vol. 30, No. 1, p.,.70-A. (Order No. 69-8659, 
103 pages). /Appendix B: Measuring Instruments, pages 80-90, 
and Appendices D and E: Experimental Materials, pages 105- 
279, not microfilmed at request of author. Available for con- 
sultation at Syracuse University Librar;^/* 



214 



RANKIN, EARL P. "USES OP THE CLOZE PROCEDURE IN THE READING 
CLINIC. READING IN A CHANGING SOCIETY . EDITED BY J. 
ALLEN PIGUREL. PROCEEDINGS OP THE INTERNATIONAL READING 
ASSOCIATION. NEW YORKt SCHOLASTIC MAGAZINES, 1959, 
228-232. 



Purpose ! The author describes the clinical utility of the 
cloze pr dure and suggests a way the procedure might be used 
in a re' clinic. 



Principles. Conce pts, or Procedures ! Rankin asserts that assess 
ment of achievement is possible with cloze, for both content 
and style would be constant when tests were made over instruc- 
tional materials. 

Cloze exercises are easy to prepare and thus can be more 
simply adapted to material of interest to the student than other 
measurement devices* 

Close assesses readability and yields immediate reinforce- 
ment. Answer keys can be used in combination with discussion 
in this situation. 

Vocabulary can be taught by deleting varying word classes. 



Conclusions i In the author •s view, the cloze procedure has 
tremendous potential as a diagnostic and remedial tool. 
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RANKIN, EARL P. "GRADE LEVEL INTERPRETATION OF CLOZE READABIL- 
ITY SCORES." PAPER PRESENTED AT THE NATIONAL READING CON- 
FERENCE, ST. PETERSBURG, FLORIDA, DECEIVER 3-5, I97O. 



Purpose { Two studies were conducted to investigate the use of 
a technique for providing a grade-level interpretation for 
cloze readability scores. 



Principles. Conce-pts, or Procedures : In the first study, Bor- 
muth*s cloze-test criteria were compared with the results of 
the Fry and Dale-Chall readability formulae. A total of I33 
students in grades 4 to 8 were required to read a 250-word 
passage with every fifth word deleted. The results indicated 
a fairly close correspondence between Bormuth's 44 percent 
criterion for cloze readability analysis and the readability 
formulae. In the second study, a method devised by the writer 
was used. The Informal Cloze Readability Inventory (ICRI) 
uses materials of unknov/n difficulty to be read by readers of 
known reading ability in order to evaluate the readability of 
a book. The ICRI and the Paragraph Meaning subtest of the 
Stanford Reading Achievement Test were given to groups of six 
average readers in grades 4 to 6. 



Conclusions t When cloze instructional levels were analyzed, 
they did not appear to be very different from the readability 
levels as measured by the readability formulae. It was con- 
cluded '■hat valid readability assessments can be mace using the 
ICRI based on a small number of subjects. References are in- 
cluded. J- 



• ^Research in Education (Washington, D.C.: United States 
Government Pr .anting Office, 1971), Vol. 6, No. 5. p. 110. 
(ED 046 657, 12 pages). 
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RANKIN, EARL P., AND OVERHOLSER, BETSY M. "REACTION OP INTER- 
MEDIATE GRADE CHILDREN TO CONTEXTUAL CLUES." JOURNAL OP 
READING . 1 (1969) t 50-73. 



Purpose t This study investigated "... the sensitivity of 
intermediate grade pupils to contextual clues described by 
Ames* (1965) Classification Schema of Contextual Aids." (50) 



Principles. Concepts, or Procedures t Two hundred eight inter- 
mediate grade pupils were administered The Context Test which 
was based on fourth grade basals not used by the pupils. The 
test utilized the cloze procedure by deleting ncuns, adjectives 
adverbs, and verbs from their contexts in accord with Ames* 
schema. Each subject completed a test in about one hour of 
each of three consecutive days. Synonyms were accepted if 
tense and grammatical structure were correct. 



Conclusions t Among the findings were the following! 

1. The difference in difficulty among the contextual clues 
were significant for intermediate grade children. 

2. The rank order of difficulty among clues was highly 
consistent among both grade levels and reading levels. 

3. Reading ability is highly predictive of ability to use 
the context clues studied here. 

^» Question-answer, comparison-contrast, main idea-suppcrt 
ing details, and non-restrictive clauses (appositive phrases) 
were most difficult for the subjects. 
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RANSONU PEGGY ELAINE HITCHCOCK. "A STUDY TO DETERMINE READING 
IKVELS OF ELET^ENTARY SCHOOL CHILDREN BY CLOZE TESTING." 
UNPUBLISHED ED.D. DISSERTATION, BALL STATE UNIVERSITY. 
1965. 



Purpose : The study was designed to determine whether or not a 
significant relationship exists between scores on a Cloze Test 
and scores on an Informal Reading Inventory. 

The nine hypotheses involved three basic problems: (1) 
the correlation of reading levels for the entire population on 
a Cloze Test and from an Informal Reading Inventory, (2) the 
correlation of reading levels obtained at each grade, one 
through six, on a Cloze Test and from an Informal Reading In- 
ventory, and (3) the correlation of levels identified on the 
Cloze Test and the Informal Reading Inventory for boys and 
for girls. r 



Principles. ConceT) ts. or Procedures : The population consisted 
of 178 students in grades one through six, in a Muncie, Indiana 
elementary school. An Informal Reading Inventory and a Cloze 
Test were constructed for use in the study. A silent reading 
test and an intelligence test were administered to the group to 
ascertain normalcy of the sample. All testing was completed 
in a six week period. 

Two sets of criteria were used in identifying levels from 
the Cloze Test. These were the 50/30/20 criteria and the raw- 
score criteria. Coefficient correlations were used to compare 
three reading levels, Independent, Instructional, and Frustra- 
tion. These levels were determined from pupil responses on 
the Cloze Test and the Informal Heading Inventory. 



Cgnclusions: The Independent, Instructional, and Frustration 
reading levels derived from the use of the Cloze Test (using 
both sets of established criteria) correlated with the Infor- 
mal Reading Inventory at the .01 level of confidence for the 
total population in grades one through six. 

For pupils in the first grade, the relationship between 



See also Peggy E. Ransom, "Determining Reading Levels 
of Elementary School Children by Cloze Testing," Appendix. 
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the results from the Cloze Test and the Informal Reading Inven- 
tory was found to be not statistically significant. 

The Instructional and Frustration reading levels were 
found to be correlated at the .01 level of confidence in grades 
two through six, respectively. 

Only at fourth grade was the Independent reading level 
determined from the two test methods (using Cloze Test 50/30/20 
criteria) statistically significant. ^ / 

For the boys scores at the Independent, Instructional, and 
Frustration reading levels derived from the Cloze Test (both 
sets of criteria) displayed correlations to the .01 confidence 
level with results from the Informal Reading Inventory. 

Reading level scores derived for the girls* at the Instruc- 
tional and Frustration reading levels, between the Cloze Test 
iboth sets of criteria) and the Informal Reading Inventory. 

^^nrtPn^^f^^-^^ f i?^^' °^ significant. At the Inde- 

pendent reading level the .01 level of confidence was estab- 
lished with the Cloze Test 50/30/20 criteria, but not with the 
Cloze Test raw-score criteria. 

T * ^^f correlations between the Cloze Test scores and the 
informal Reading Inventory scores at the Instructional and 
Frustration reading levels, grades two through six, were sta- 
tistically significant. This relationship indicated that a ■ 
Cloze Test could aid the teacher in determining the appropriat.? 
Instructional reading level for children in a classroom for 
these grades when administered at the beginning of the school 
year. The Cloze Test also would indicate the level of material 
which would be frustrating for children in these classes. 

*i ^t^^f?"^ grade performance on the two tests yielded no sta- 
tistically significant relationship. A higher correlation 
might have occurred had the testing been administered nearer 
the end of the school year. 

The Cloze Test 50/30/20 criteria, based on percentages of 
?hr?a^-scorc?fte?Iar' '° ^ 

Cloze testing which can be administered to an entire 
»}«?f+f2r^ iu"*®: ?! average length of time required for ad- 
ministering the test to the group in this study was fortv 



219 



minutes. The instrument is easily applied and can be inter- 
preted by qualified teachers who have had no special training 
in test administration. Tt was concluded that the Cloze Test 
can provide a more efficient procedure for identifying In- 
structional and Frustration reading levels in the elementary 
schools. ■'• 



Dissertation Abstracts (Ann Arbor, Michigan » University 
Microfilms, 1966), Vol. 26, No. 7. pp. 3705-3706. (Order No. 
65-13#038^ 133 pages). 
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ROBINSON, RICHARD DAVID. "AN INVESTIGATION INTO THE USE 0^ THE 
CLOZE PROCEDURE WITH A GROUP OF FUNCTIONALLY ILLITERATE 
ADULTS." UNPUBLISHED ED.D. DISSERTATION, UNIVERSITY OF 
GEORGIA, 1971. 



Purpose t The purpose of this study was to investigate the use 
of the cloze procedure with a group of functionally illiterate 
adults. Several segments of this problem were investigated. 
First, the study sought to test three types of cloze construc- 
tion as predictors of a standardized reading test. Second, 
the cloze procedure was tested against several readability 
formulas in ranking seven reading passages. The third purpose 
was the gathering of information on the opinions of cloze held 
by this population. 



Principles, Concepts, or Procedures! The sample for the study 
consisted of 57 inmates of the United States Federal Peniten- 
tiary in Atlanta, Georgia. Test scores collected for use in 
this research included results from the Paragraph Meaning pnd 
Word Meaning subtests of the Stanford Achievement Test . In- 
telligence was measured by the Revised Beta Examination . Only 
subjects who scored between grade levels 4.0 and 7.9 and had an 
intelligence score of 90 or above were included.- 

. V. addition to these standardized tests, three instruments 
were used to measure various aspects of the cloze procedure, 
ine first test was developed to evaluate three different types 
+ as predictors of a standardized reading 

test. The various cloze deletion methods included: I-5 dele- 
tion, noun-verb deletion and multiple-choice deletion. The 
second test consisted of seven passages which were ranked by 
cloze and various readability formulas. The third instrument 
was a cloze opinion survey. 

4.U I^ata taken from these tests were treated statistically by 
the use of simple correlation, stepwise regression analysis, 
and canonical correlation. 



Ponclusion s: A positive and significant relationship was found 

!^''S®'^.°i°^®.^"^ deletion and the subtests. Paragraph Meaning 
and Word Meaning, taken from the Stanford Achievement Tpst . in 
addition, mulciple regression analysis indicated that 1-5 dele- 
a significant predictor of the same subtests. The 
canonical correlation gave added weight to the use of the 1-5 
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cloze deletion technique. The implication of these findings 
is that in this population, or in ones similar, the 1-5 cloze 
deletion may predict certain reading abilities as well as 
standardized testing. 

A rank order correlation between the ranking of seven pas- 
sages by cloze as compared with rankings using readability for- 
mulas was not significant. An important finding based on these 
results is the wide differences between the use of cloze and 
readability formulas in measuring passage difficulty. Previous 
research has shown the limitations of selecting material for 
m£f illi'fcerate adult based on the use of readability formulas. 
TBDe selection of the cloze procedure as an alternative seems 
to have some basis for its use under these circumstances. 

The results of the cloze opinion survey indicated a posi- 
tive feeling toward the cloze procedure. This result should 
have some bearing on whether a teacher would want, to use cloze 
with a group of functionally illiterate adults. Additional re- 
search is needed on this question.^ 



Dissertatio n Abstracts International At The Humanities 
and Social Sciences (Ann Arhnr. Mirhigrflnt University Micro- 
films, 1972), Vol. 32, No. 7, p. 3572-A. (Order No. 72-2535, 
157 pages). 



ERIC 
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SAUER, FREDA MAE. "THE DETERMINATION OF READING INSTRUCTIONAL 
LEVEL OF DISABLED FOURTH GRADE READERS UTILIZING CLOZE 
TESTING PROCEDURE." UNPUBLISHED ED.D. DISSERTATION, OKLA- 
HOMA STATE UNIVERSITY, I969. 



Purpose ; The primary objective of this study was to determine 
whether or not Cloze Testing is a valid procedure to determine 
the instructional grade level of fourth grade disabled readers. 
This study was one of four, all independent in nature, utiliz- 
ing the same population to obtain diagnostic information about 
the reading skills of this particular population. 



Principles, Concepts, or Procedures : Data were utilized from 
a total of 191 fourth grade children selected from the 3^ par- 
ticipating schools, both rural and urban, in Kay County, Okla- 
homa. The Cloze Test was also administered to entire hetero- 
geneous classrooms from the same community, and included 
children. 

A Cloze Test of original materials was prepared specifi- 
cally for this study. Three stories were composed, sequential 
in nature, of approximately 200 words per page with the first, 
second, and third. pages written respectively at the 2.0, 2.5, 
and 3.0 readability levels as measured by the Spache readabil- 
ity formula. 

The Reading subtests of the Stanford Achievement Test . 
Primary II . Form W, were administered to those pupils whose 
teachers* evaluation placed them in the lov/er one-third of 
their class in reading achievement. The Standard Reading; In - 
ventory . Form B, v/as administered to randomly selected pupils 
with Stanford Heading Test scores from either test ranging be- 
tween 2.0 and 4.5. Those pupils whose Standard Reading Inven - 
tory test scores (evaluated by three reading clinicians) 
placed them in the instructional grade level range of I.5 to 
3*9 were selected to comprise the population for this particu- 
lar study. 

Statistical Procedure: The procedure for statistical 
analysis was -antecedent probability and psychometric cutting 
scores and signs. Two conditions for demonstration of prac- 
tical efficiency of the Cloze instrument were specified. Match- 
ing membership scores were the concern. 
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Conclusions ! The statistical procedure consistently rejected 
the hypotheses that cloze technique is a valid procedure to 
determine the instructional reading grade level of fourth 
grade disabled readers. The one exception is to be viewed 
with skepticiijm due to the small population. 

Recommendations pointed toward cloze research that would 
analyze the specific kinds of incorrect responses that are 
made by disabled readers to give guidelines for reading com- 
prehension instruction. It was further recommended that tests 
be designed that measure the absolutes of a specific reading 
skill. 1 



^Dissertation Abstracts International At The Humanities 
and Social Sciences (Ann Arbor. Minhiggwi ^University Micro- 
rilms, 1971). Vol. 31, No. 8, p. 4o46-A. (Order No. 70- 
21. W, 153 pages). 
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SCHNEYER, J. WESa:£Y. "USE OP THE CLOZE PROCEDURE FOR IMPROV- 
ING READING COMPREHENSION." THE READING TEACHER . 19 
11965). 17*^-179. 



Purpose » The author reports a study undertaken to investi- 
gate the effects of the cloze procedure upon the reading com- 
prehension of sixth grade pupils. 



Principles. Concepts, or Procedures * A series of 200-word 
passages were chosen by the author from a basal reading 
series. Two types of exercises were prepared. One utilized 
every-tenth-word deletions regardless of word class while the 
other deleted noun and verbs only. Twenty deletions were 
made in each passage. Three exercises of each type were pre- 
pared at each reader level: a total of 57 exercises. 

There were 32 subjects in the experimental group and 34 
in the control group. Measures of reading achievement and 
intelligence were given through the Gates Reading Survev and 
the California Teat of Mental Maturitv . 



Conclusions' . j 

1. The experimental group did not show significantly 
greater iinprov»ent in reading comprehension. 

2. Scores from both cloze test forms were significantly 
related to reading comprehension, vocabulary, word recogni- 
tion, and verbal ability. 

The author accounts for the lack of improvement in the 
experimental group to the absence of discussion following 
scoring. 



225 



SCHOELLES, IRIS STOREY. "CLOZE AS A PREDICTOR OF READING GROUP 
PLACET/iENT." PAPER PRESENTED AT THE ANNUAL MEETING OF THE 
INTERNATIONAL READING ASSOCIATION, ATLANTIC CITY, NEW JER- 
SEY, APRIL 19-23. 1971. 



Purpose ; Four questions concerning the relationship between re- 
sults of cloze test scores and individual reading ability are 
investigated: (1) Is there a relationship between the cloze re- 
sults and individual reading ability? (2) Should cloze tests 
be written at mean grade level? (3) Which provides higher cor- 
relations—giving credit for exact responses only or for exact 
responses and synonyms? and (4) Can the cloze test be considered 
a valuable part of student reading assessment? 



Principles, Concepts, or Procedures ; Four hundred and seventy 
students in grades 1 through 5 at a Snyder, New York, elemen-" 
tary school were administered both the Stanford Achievement Test 
and cloze passages from basal readers. Correlation of the 
scores ranged from .64 to .76 using cloze material near the 
grade mean. It appeared that greater dispersion- of the popula- 
tion is achieved through use of more difficult materials'. 
Scoring synonyms and exact words was found desirable. 



Conclusions? It was concluded that advantages of the cloze test 
are Tl) that the student must comprehend what he is reading to 
do well, while random guessing can lead to high scores on the 
Stanford test and (2) there is no time limit on the cloze, hence 
the slow, careful reader scores well while the fast random 
guesser does not. Tables and references are included. J- 



^ Research in Education (Washington, D.C.: 'Inited States 
Government Printing Office, 1971). Vol. 6, No. 12, p. 74. 
(ED 053 868, 6 pages). 
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SMITH, EUAER L. "USE OP THE CLOZE PROCEDURE IN IMPROVING COM- 
PREHENSION OF JUNIOR COLLEGE READERS." PAPER PRESENTED 
AT THE NATIONAL READING CONFERENCE, ATLANTA, GEORGIA, 
DECEMBER I969. 



Purpose : Uses of the cloze procedure for both diagnosis and 
for practice exercises for improving reading comprehension in 
a junior college reading program are described. 



Principles. Concepts, or Procedures : Every tenth concept 
word — nounst verbs, adjectives, and adverbs — was omitted from 
expository prose selections of about 350 words each, and the 
reader was asked to write the missing word in the blank pro- 
vided. Following completion of the writing, the teacher and 
students reviewed the responses orally* An additional proce- 
dure was added in which the students looked over the cloze 
exercise before doing it and noted unfamiliar words* 



Conclusions t Use of the cloze procedure was found to be par- 
ticularly effective for (1) demonstrating the process of com- 
prehension- -how words combine with words into wider units of 
meaning, (2) demonstrating the part grammatical knowledge 
plays in comprehension, (3) pointing out to students their 
own deficiencies in the comprehension process, and (4) pro- 
moting discussion about particular reading selections and 
about the process of reasoning which is reading comprehension. 
References are included*^ 



Research in Education (Washington, D.C.t United States 
Government Printing Officet 1970), Vol. 5f No* 9$ P« 77# 
(ED 039 091, 9 pages). 
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STEWART, ELNEITA V/ALLACE. "A COMPARATIVE STUDY OF THE EFFEC- 
TIVENESS OP CLOZE AND TEXTBOOK PROCEDURES IN A COLLEGE 
READING PROGRAT^." UNPUBLISHED ED.D. DISSERTATION, UNI- 
VERSITY OP HOUSTON, 1967 >1 



Purpose ; This study was designed to answer the following ques 
tions: 

1. Do methods of teaching reading in which cloze proce- 
dures are used result in better total reading achievement, com 
prehension and vocabulary than methods in which reading text- 
books are employed? 

2. Is growth in total reading achievement, comprehension 
or vocabulary affected by the age of the learner? 

3# Is growth in total reading achievement, comprehension 
or vocabulary affected by I#Q#? 



Principles, Concepts, or Procedures : The experimental method 
was used to collect the data# Eighty-nine high school gradu- 
ates who were enrolled in an eight-week English-Mathematics 
Institute which included a reading program were randomly 
assigned to two comparison groups • 

The 47 students in the experimental group used cloze read 
ing exercises as their chief learning material. The cloze se- 
lections were prepared by deleting every fifth word excluding 
proper nouns, dates and numbers • The selections were taken 
from the same college reading textbook that the control group 
used* One illustrated lecture on using one's knowledge of 
syntax as an aid to reading comprehension was given to the ex- 
perimental group. The 44 students in the control group used a 
college reading textbook as their chief learning material. 

Both cloze and textbook groups met twice per week in 
class periods of 55 minutes in length and were taught by the 
same instructor. 



CoriClusions : The findings were as follows t 

It The hypothesis that the 4? students who used cloze 



•*"See also Elneita Wallace Stewart, '•Reading Improvement 
Program for College Students," Appendix. 
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reading materials would experience more growth in reading 
achievement than the 44 students who used the textbook as the 
chief learning material was rejected at the five per cent 
level of confidence. 

2. Reading achievement was not affected by age. 

3. Reading achievement was not significantly affected by 

1 .Q . 

Based on the findings, it was concluded that the cloze 
procedure was not significantly better than the textbook method. 
Neither did it prove to be less effective. The small differ- 
ences in gain in reading ach:' -svement favored the cloze group. 

In view of the findings, as well as strong support from 
learning theory, it was recommended that further research 
should be done on the cloze procedure as a method of teaching 
leading to college students. It was further recommended that 
the hypotheses of this study should be experimentally retested 
with the following alterations in design and procedure: 

1. Use matched pairs as subjects. 

2. Use cloze reading materials that are designed to en- 
hance conceptual thinking. 

3. Use cloze reading materials over a longer period of 

time. 

4. Give subjects in the cloze group more structured in- 
struction on reading comprehension and structural linguistics. 



^Dissertation Abstr acts A» The Humanities and Social 
Sciences (Ann Arbor, Michigan: University Microfilms, 1968), 
Vol. 28, No.. 12, Part 1. (Order No. 68-7862, 11? pages). 
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WIECHEi;/IAN, DUANE SYLVESTER. "A COMPARISON OF CLOZE PROCEDURE 
SCORES AND INFORT^AL READING INVENTORY RESULTS FOR ESTI- 
MATING FUNCTIONAL READING LEVELS FOR STUDENTS AT EIGHTH 
GRADE LEVEL." UNPUBLISHED ED.D. DISSERTATION, UNIVERSITY 
OP NORTHERN COLORADO, 1971. 

Purpose ; The purpose of this study was to compare the func- 
tional reading levels identified with a cloze test with the 
functional levels identified with an Informal Reading Inventory 
for eighth grade students. 

Four major hypotheses were formulated and stated in the 
null form for the purposes of this study. They were as follows 

Hypothesis 1: There will be no significant relationship 
between the reading grade levels attained by eighth grade 
students on a cloze test and on an Informal Reading In- 
ventory for identifying the following: 

a) independent reading levels 

b) instructional reading levels 

c) frustration reading levels 

Hypothesis 2: There will be no significant differences 
between the mean scores attained by eighth grade students 
on a cloze test and on an Informal Reading Inventory for 
identifying the . following : 

a) independent reading levels 

b) instructional reading levels 

c) frustration reading levels 

Hypothesis 3» There will be no significant difference be- 
tween the mean instructional reading levels attained on a 
cloze test and on an Informa] Reading Inventory by eighth 
grade students who are reading as follows: 

a) at grade placement 7.5 or above 

b) below grade placement 7,5 

Hypothesis k-t There will be no significant difference be- 
tween the mean instructional reading levels attained by 
eighth grade Spanish surnamed students on a cl-ze test and 
on an Informal Reading Inventory. 
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Principles^ Concepts, or Procedures ! There were seventy-one 
eighth grade students included in this study, thirteen of whom 
were Spanish surnamed. A test utilizing the cloze technique 
was developed for the study. Cloze criteria for functional 
reading levels were as follows: Independent Reading Level— 5? 
per cent correct responses} Instructional Reading Level— -if^ 
per cent but less than 57 per cent correct responses; and. 
Frustration Reading Level— less than 35 per cent correct re- 
sponses. An I HI was individually administered to the subjects. 
Betts* criteria was used to identify functional reading levels. 

Correlations were computed between the functional reading 
levels obtained with the cloze test and the IRI. The Pearson 
Product-moment measurement was used. Means were computed for 
the functional reading levels obtained with the cloze test and 
the IRI. The mean instructional reading levels obtained with 
the cloze test and the IRI were computed for selected subgroups. 
The t test for related samples were used to determine the sig- 
nificance of the differences between the means. The .01 level 
of confidence was used as the criterion for significance. 

For descriptive purposes the individual students* func- 
tional reading levels identified with the cloze test and the 
IRI were compared. In addition the reading grade level scores 
obtained with the Durrell Li«3tening-Reading Series , a standard- 
ized test, were compared with the instructional reading levels 
obtained with the cloze test and the IRI. 



Conclusions: On the basis of the findings and the limitations 
imposed by the study, the following conclusions were drawn: 

1. There was a positive relationship between the functional 
reading levels identified with the cloze test and the IRI. 

2. Mean functional reading levels identified through the 
use of the cloze test for the eighth grade students did approxi- 
mate their r.ttained mean functional reading levels through the 
use of the IRI. 

3. Even though the variability was greater, the mean in- 
structional reading levels obtained using the cloze test for 
the eighth grade students reading at grade level 7.5 or above, 
and below grade level 7.5 did approximate the mean instructional 
reading levels obtained using the IRI for eighth grade students 
reading at grade level 7.5 or above, and below grade level 7.5. 
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The mean instructional reading level for the eighth 
grade Spanish surnamed students which was obtained using the 
cloze test did approximate their mean instructional reading 
level obtained using the IRI. 

An analysis of the functional reading levels attained by 
individual students through the use of the cloze test and the 
IRI revealed that for all comparisons made, there were greater 
variabilities among the cloze test results than among the IRI 
results. When compared with the IRI, the cloze test identified 
individual students* instructional reading levels more accu- 
rately than did the Durrell Listening- Reading Test , J- 



•^Dissertatio n Abstracts International A: The Humanities 
and Social Sciences (Ann Arbor. Michigan t University Micro- 
films, 1972), Vol. 32, No. 7f pp. 3583-A, 358^-A. (Order No. 
72-3317, 205 pages). 
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SECTION I 

Suggested Readings Related to 
"THE CLOZE PROCEDURE: AN OVERVIEtf" 

1. Bickley, A. C.I Ellington. Billie J., and Bickley, Rachel 

I « . Cloze Procedure: A Conspectus." Journ al 
of Readi ng Behavior . 2 (1970), 232-249. 

2. Green, Richard T. Comprehens ion in Reading: An An no- 

tated Bibliograph.Y. Newark, Delaware: Internition- 
al Reading Association, 1971. 22 pages. 

3. Greene, Frank P., et al. "Cloze Symposium." Multidis - 

Ciplinary Aspects of College -Adult Reading Edited 
by G. B. Schick and U. M. May. Seventeenth Year- 
book of the National Reading Conference. Milwaukee, 
Wisconsin: National Reading Conference, 1967, 110- 
131 • 

4. Hafner, Lawrence E. "Cloze Procedure." Journal of Read - 

IXig, 9 (1966), 415-421. ^ 

5. Mork, Theodore A. "Clozing the Placement Gap: A New 

Tool for Administrators and Teachers." Educatio nal 
Leadership. 28 (April 1971\ 763-767. 

6. Potter, Thomas C. A Taxonomv of Cloze Research. Part I. 

Readability and Kead ing Comprehension . InglewoodT 
Calxfornia: Southwest Regional Educational Labora- 
tory, 1908, 51 pages. 

7. Rankin, Earl F., Jr. "The Cloze Procedure - A Survey of 

Research." The Philosophical and Son^oin^^ooi ^ 
Bases of Re^amg. Edited by Eric L. Thurston and 
Lawrence E. Hafner. Fourteenth Yearbook of the 
National Reading Conference. Milwaukee, Wisconsin: 
National Reading Conference, 1964, I33-150. 
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8. Taylor, Wilson L., and Waldman, Ivan L. "Latency and 
Focus Methods of Cloze Quantification." Reading : 
Process and Pedagogy - Volume II. Edited bv G* B. 
Schick and M. M. May. Nineteenth Yearbook of the 
National Reading Conference. Milwaukee, Wisconsin: 
National Reading Conference, 1970, 241-262. 

9* Weintraub, Samuel. "The Cloze Procedure." The Reading 
Teacher, 21 (I968), 567-571, 607. 



Suggested Readings Related to 
"THE CLOZE PROCEDU^- "S A MEASURE OF READABILITY" 



1. Bormuth, John R. "Clr .- ?.s a Measure of Readability." 

Reading as an In. I.ectual Activity . Edited by J. 
Allen Figurel. jeedings of the annual convention 

of the Internati^ - Reading Association, New York, 
N.Y. I Scholastic »viagazines, I963, I3I-I34. 

2. "Designs of Readability Research." Vistas in 

Reading . Edited by J. Allen Figurel. Proceedings 
of the annual convention of the International Read- 
ing Association. Newark, Delaware! International 
Reading Association, I966, 485-489. 

The Implications and Use of the Cloze Procedure 



in the E valuation of Instructional Programs . Los 
Angeles: Center for the Study of Evaluation of In- 
structional Programs, University of California, I967, 
55 pages. 

^« • "Cloze Test Readability: Criterion Reference 

Scores." Journal of Educational Measurement . 5 
(1968), I89-I96. ^ 

5* Coleman, E. B. "Experimental Studies of Readability, 

Part II." Elementary English . 45 (1968), 316-324. 

6. Gallant, Ruth. "Uae of Cloze Tests as a Measure of 

Readability in the Primary Grades." Reading and 
Inquiry. Edi»;ed by J. Allen Figurel. Proceedings 
of the annual convention of the International Read- 
ing Association. Newark, Delaware! International 
Reading Association, I965, 286-287. 
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7. Jefferson, George L., Jr. "Lexical and Structural Items 

as Predictors of Readability for High and Low Abil- 
ity Readers." P.iper presented at the National Read- 
ing Conference, Atlanta, Georgia, December 4-6, 
1969t 12 pages. 

8. Kingston, Albert J., and Weaver, Wendell W. "Recent De- 

velopments in Readability Appraisal." Journal of 
Reading . 11 (196?) , 4^^-47. 

9. Klare, George R. The Measurement of Readability . Ames, 

Iowa« Iowa State University Press, 1963, 84-85. 

10 • • "Comments on Bormuth's Readability* A New 

Approach." Reading Research Quarterly . 1 (1966), 
119-125. 

11. MacGinitie, Walter H. "Contextual Constraint in English 

Prose Paragraphs." Journal of Psychology . 5I (I96I), 
121-130. ^ 

12. , , and Tretiak, Richard. "Sentence Depth Mea- 

sures as Predictors of Reading Difficulty." Read - 
ing Research Quarterly . 6 (I971), 36^-377. 

13* McLeod, John, and iinderson, Jonathan. "Readability 

Assessment ani Word Redundancy of Printed English." 
Psychologi cal Reports . 18 (1966), 35-38. 

I'l'. Rothkopf, Ernst Z. "Textual Constraint as Function of 
Repeated Inspection." Journal of Educational Psy - 
chology . 59 (1968), 20-25. 

15. Ruddell, Robert B. "A Study of the Cloze Procedure Tech- 
nique in Relation to Structurally Controlled Read- 
ing Material." Improvement of Reading Through Class - 
rooii Practice. Edited by J. Allen Pigurel. Pro- 
ceedings of the annual convention of the Internation- 
al Heading Association. Newark, Delaware* Inter- 
national Reading Association, 1964, 298-303. 
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Suggested Readings Related to 
"THE CLOZE PROCEDURE AS A MEASURE OP COMPREHENSION" 



1. Aaron, Robert L., and White, William F. "Racial Effect 

in Reading Comprehension." Paper presented at the 
American Educational Research Association Conference, 
Chicago, February 6-10, 1968, 5 pages. 

2, Aquino, Milagros, et al . "Reading Comprehension Difficul- 

ty as a Function of Content Area and Linguistic Com- 
plexity." Journal of Experimental Education . 3? 
(1969), 1-4: 

3» Bormuth, John R. Relationships Between Selected Language 
Variables and Comprehension Ability and Difficulty . 
Washington, D» C.i United States Department of 
Health, Education* and Welfare, 1964, I3I pages. 

4. • "The Effectiveness of Current Procedures for 

Teaching Reading Comprehension," Paper presented 
at -aie annual convention of the National Council of 
Teadiers of English, Milwaukee, Wisconsin, November 
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5. Feldman, Margaret E. "Learning by Programmed Text 

Poraat at Three Levels of Difficulty." Journal of 
Educational Psvchologv . 56 (I965), 133-139. 

6. Ceyer, Janes R. Cloze Procedure as a Predictor of Com - 
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7. Greener Frank P. "Modification of the Cloze Procedure 
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of Bttucational Measurement . 2 (I965), 213-217. 

8. Hater, Maory Ann, and Kane, Robert B. The Cloze Proce - 
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10. Kni^t, David, and Alcorn, John D.' "Comparison of the 
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